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SANTA MONICA, CA. 904Qb 



PREFACE 



This Report is a product of Rand’s study of performance contracting in educa- 
tion. The study is sponsored by the Assistant Secretary for Planning and Evaluation, 
U.S. Department of Health, Education and Welfare, under Contract No. HEW*OS> 
70-166. 

Case Studies in Educational Performance Contracting comprises six volumes. 
Each is a self-contained study; together they provide a multifaceted view of perform- 
ance contracting. The six volumes are: 

1. R-900/1-HEW, Conclusions and Implications^ by P. Carpenter and 
G. R. Hall 

2. R-900/2-HEW, Norfolk, Virginia, by P. Carpenter 

3. R-900/3-HEW, Texarkana, Arkansas and Liberty-Eylau, Texas, by 
P. Carpenter, A. W. Chalfant, and G. R. Hall 

4. R-900/ 4 HEW, Gary, Indiana, by G. R. Hall and M. L. Rapp 

6. R-900/5-HEW, Gilroy, California, by M. L. Rapp and G. R. Hall 

6. R-900/6-HEW, Grand Rapids, Michigan, by G. C. Sumner 

'^1 

This study is the second of three Rand Reports on the subject. The first Report 
was J. P. Stacker and G. R. Hall, The Performance Contracting Concept in Education, 
The Rand Corporation, R.699/1-HEW, May 1971. The third Report will be a per- 
formance contracting guide intended for use by educational offlclals. 



SUMMAEY 



Grand Rapids is a city C'f 200,000 in southwestern Michigan. Total pupil enroll- 
ment in the Grand Rapids school district is around 41,000. During the 1970-71 school 
year, the district had performance contracts for reading and math instruction with 
three commercial firms: Alpha Learning Systems, Inc. (Alpha), Combined Motiva- 
tion Education System, Inc. (CMES), and Westinghouse Learning Corporation 
(WLC). 

The CMES AND WLC contracts were independently obtained on sole source 
bases. The Alpha program was part of the Office of Economic Opportunity experi- 
ment in performance contracting. The programs of all three contractors featured 
contingency management and individualized instruction, and all used commercially 
available materials and equipment. 

The WLC program initially accommodated 220 low achievers in two inner-city 
elementary schools, grades 1-6. Modifications were made after the first semester to 
accommodate all but the speciafeducation pupils, increasing the WLC program 
enrollment to about 340. The contract fee was $149.60 per achievement-year gain 
per student as measured by standardized achievement testing. There was no pay- 
ment for any student who did not gain at least one year. WLC operated a moderately 
hardware-oriented program in rooms that were furnished much more comfortably 
than regular classrooms. 

The CMES program accommodated around 650 low-achieving pupils (including 
special-education pupils) in an inner-city middle school, grades 6-9. The contract fee 




was $60 per achievernent-year gain per student. The CMES program was highly 
h'.rdware-oriented, and again the rooms were furnished much more comfortably 
than regular classrooms. 

The Alpha program accommodated 300 low achievers in a middle school in 
grades 7-9, and 300 low achievers in two elementary schools in grades 1-3. All schools 
were in the inner city. Three-fourths of the contract fee was determined on a sliding 
scale, varying from $60 to $160 per achievement-year gain per student. The rest of 
the payment was based on satisfactory performance on interim mastery tests. The 
Alpha program involved no special furnishings or instructional equipment. 

At the end of the year, it was necessary to negotiate payment on both the WLC 
and the CMES contracts because of excessive absences, program changes, or other 
conditions not anticipated in the contracts. 

Average achievement gains in the WLC program for pupils who atiended at 
least 150 days were 0.67 in reading and 0.68 in math (as measured by the Metropoli- 
tan Achiovement Test). In the CMES program, average achievement gains for pupils 
who attended at least 150 days were 1.2 in reading and 1.0 in math (as measured 
by the Educational Development Series published by Scholastic Testing Service). 
Achievement data for the Alpha program were not available at the time of this 
publication. 

Most district personnel involved with the programs were favorably impressed, 
and did not think it fair to judge effectiveness on the basis of first-year results. The 
district decided to hold final judgment in abeyance for a year. Accordingly, follow-on 
contracts were awarded for all three programs. The performance payment machin- 
ery was modified for the CMES and Alpha contracts, and was dropped altogether 
from a contract with Learning Unlimited (headed by a former WLC official, Learn- 
ing Unlimited assumed WLC’s instruction management activities at the end of the 
1970-71 school year). Alpha and Learning Unlimited were also awarded contracts 
for programs in other Grand Rapids schools. 

The Grand Rapids experience underscores the value of performance contract- 
ing as an agent for introducing instructional innovations. It also indicates that the 
performance contract is a useful device to guarantee active contractor participation 
in the program modifications that are generally required to adapt to the particular 
needs of a district. 
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I. INTRODUCTION 



With three performance contracting programs for reading and mathematics. 
Grand Rapids was in a unique position among school districts during the 1970-71 
school year. No other school district had so many reading and math programs under 
way.‘ The three commercial contractors. Alpha Learning Systems, Inc. (Alpha), 
Combined Motivation Education Systems, Inc. (CMES), and Westinghouse Learning 
Corporation (WLC) use somewhat different educational systems, but the Grand 
Rapids School District (GRS) decided that the programs of all thi ue have sufficient 
benefits to warrant continuation with modifications during the 1971-72 school year. 
Significantly, there was less utilization of performance payment in the follow-on 
contracts. 

The opportunity to study the programs of three different contractors within a 
single school district, the midyear decisions that had to be made, and the outcomes 
of the programs make Grand Rapids an extremely instructive case study of perform- 
ance contracting in education. This Report doBcribes the three programs and how 
they evolved during the 1970-71 school year. It also discusses the achievement 
results and some of the other program outcomes.® 

* Dallas, Texas also had three performance coutracts during lfi'70-71, but not all were for reading and 
mathematics. 

* The report concentrates on the WLC hndCMES programs because the Alpha program Is part of the 
Office of Economic Opportunity performance contracting experiment and will receive attention in OEO 
evaluation reports. 



The Report makes no attempt to identify the "best” program. The achievement 
patterns, participant characteristics, management practices, program goals, and 
resource consumption patterns are so multidimensional and diverse among the 
three programs that any ranking must depend on the subjective assessment of the 
beholder. In the Grand Rapids case, GRS sensibly chose to hold program compari- 
sons in abeyance for a year until more data and more information on the post- 
shakedown period would be available. This Report presents information that GRS 
may find relevant for comparisons and decisionmaking evaluations. Nonetheless, 
since there are no simple common denominators that can combine all input and 
output aspects of a program, normative comparisons among programs are subjective 
and should properly be made by school officials, not researchers. 

This Report has six major sections. Section II briefly describes Grand Rapids 
and its school system. Sections III, IV, and V, respectively, describe the district’s 
experiences with CMES, WLC, and Alpha. Section VI editorializes on implications 
drav/n from the Grand Rapids experience with perforirance contracting. The appen- 
dixes reproduce the pertinent contracts. 



II. GRAND RAPIDS PUBLIC SCHOOLS 



Grand Rapids straddles the Grand River in southwestern Michigan (Fig. 1). The 
city’s population is 200,000s and there are half a million people in the metropolitan 
area. The city has long been known for furniture manufacturing, although most of 
that industry has moved to the Carolinas. The furniture manufacturers still left in 
Grand Rapids include the American Seating Company, the largest manufacturer of 
transportation seats, football stadium seats, and the like. There are three General 
Motors plants in Grand Rapids, and a variety of diversified manufacturing. The area 
around Grand Rapids is agricultural; it has a well-diversified and prosperous 
economy. The downtown area of the city is old and shows the marks of a number 
of buildings having been torn down for parking lots; there has been considerable 
urban renewal. 

Grand Rapids housing is almost completely segregated. The black community 
(about 20 percent of the population) is bounded by the river on the west and the 
downtown area to the north. Whites, mostly of Polish and Dutch extraction, live 
west of the river, north of downto.m, and in the suburbs. 

About 70 percent of the students in Grand Rapids attend public schools. The 
other 30 percent are split fairly evenly between the Roman Catholic schools and the 
Christian schools (the parochial schools of the Christian Reformed Church). The 
latter church embodies a theologically more conservative wing that also maintains 
a small parochial school system, There are four public high schools and four nonpub- 



lie high schools; two of the latter are Cauholic and two are Christian Reformed. The 
local Calvin College is also an offspring of the Christian Reformed Church. 



DISTRICT SCHOOLS 

The Grand Rapids School District is unified, and includes a junior college. Total 
enrollment is 41,000. An overall student profile is provided in Table 1. 

The school system is almost completely segregated. A few years ago, the 
NAACP protested the master plan of the School Board on the basis that it per- 
petuated this segregation, and demanded that many of the schools in the black 
neighborhood be closed down. More recently, after the plan had been modified, the 
blacks protested because schools were not being built in their neighborhood. In 
December 1970, the NAACP filed suit against the district, charging segregation at 
South Middle School and ter* elementary schools. 

Some integration has been achieved through busing black students to white 
schools. This has led to occasional racial disturbances. For example. Union High 
School was closed down for seven days in May 1971 because of alleged differential 
treatment of blacks. 

Busing has aroused the preriictable communftv furor, and was apparently sig- 
nificant in securing the election of a faction to the School Board that is opposed to 
busing. In an opinion survey administered by the district in January 1971, respond- 
ents voted the busing program as the biggest defect in the school system. 

A less controversial busing arrangement takes place in connection with the 
district’s Educational Park program. At Central High School and the adjacent junior 
college, a number of specialized classes are taught for which any high school student 
in the city can register, A fleet of buses is maintained to transport children from 
their own high schools to Educational Park. In 1970-71, about 2000 pupils in Educa- 
tional Park enrolled for about 3000 student-units. Educational Park increases the 
number of subject offerings available in the schools; it makes specialized staffing 
easier, and it has brought about some integration. 

The School Board has seen considerable turnover in recent years. It is a nine- 
man board, with three members elected for three-year terms each year. From 1960 
to 1962, there were only five changes on the Board. From 1962 through the current 
year there have been 18 changes, primarily in reaction to the master plan in general 
and the busing program in particular. During the last year, the Board tended to split 



Table 1 



CHARACTERISTICS OF GRAOT RAPIDS STUDENTS 
(In percentage) 



I 

t 




Racial ethnic^ 

White * p , , 

Black p p p p p . . p 

Spanish surname •«#. p « 

Other ppppppppppppppppppppppppp 

Student turnover^ 



Including changes among schools 

1969^^0 ppppppppppppppppppppp 
IS^O'^^l ppcp pppppppppp pppppp p 

To nondistrict schools only 

1969^70 ppppppppppppppppppppp 
1970^71 ppppppppppppppppppppp 



pppppppppppppppp 



■p^ppppppppppppp 

pppppppppppppppp 



84% 

14 

1 

1 



18 

13 

9 

6 



Low- Income ncudencs 



ebonc 33% 



Sex CSeptenibar 1970) 

Girls 






52 

48 



SOURCE: Taken from the 1970 application for Title I funds, 

a 

All children living in the district. Including all those 
attending nonpublic schools (about 30 percent) . 

Calculated as the ratio of students leaving during the 
school year to students enrolled in September, repressed as a 
percentage. 




rather consistently on certain issues. Four seats were at stake in the hotly contested 
election of August 1971, and the thrust of much of the campaign was a drive by some 
campaigners to unseat the remaining board members who voted for the original 
master plan. 



THE MICHIGAN STATE ASSESSMENT OF GRAND RAPIDS SCHOOLS 

The State of Michigan’s assessment of economic status and academic achieve- 
ment provides rough comparative information that is useful in forming a profile of 
the district. The Assessment is administered yearly to Michigan school districts by 
the Michigan Department of Education. Grand Rapids’ ratings on the 1970 Assess- 
ment are summarized in Table 2. It should be noted that these data have serious 
drawbacks. 

Part of the Assessment is a test designed by Educational Testing Service for 
fourth- and seventh-graders. Whether a school receives Michigan Section 3 funds 
(for aides, etc.) depends on how poorly the students score on this test (26 points) and 
how poorly they rate on an SES (socioeconomic status) questionnaire they are asked 
to fill out (10 points). GRS has discovered a very serious , . sponse-bias problem with 
the questionnaire: it seems the students respond according to their aspirations 
rather than actual status (e.g., how many color TVs does your family own?). For 
example, one of the poorest schools in the district received 26 achievement points, 
but none of the 10 SES points. Furthermore, some schools elsewhere in the state 
refused to administer the questionnaire, only to find out later that it would be part 
of the basis for funding. At a special session in September, 1970, the legislature voted 
to guarantee that any school receiving Section 3 funds in 1969-70 would be funded 
in 1970-71 at one-half rate at least. Several districts in the state boycotted the 
assessment in 1970-71, preparing the way for a confrontation on the matter. Conse- 
quently, the data should be regarded as only roughly indicative of true socioeco- 
nomic and achievement levels. 



DISTRICT FINANCES 

* 

In the 1968-69 school year, the dollars-per=student factors for the district were 
$676 for secondary, $649 for elementary, $1363 for special education, $660 for junior 



Table 2 



MiCHIGAN STATE ASSESSMENT OF GRAND RAPIDS SCHOOLS, 
FOURTH AND SEVENTH GSADES, 1970 

(Percentile ratings)® 



Item 


Michigan 

Norma 


Michigan 

Core^Citles 

Norms 


4 th 


7th 


4 th 


7 th 


Socioeconomic status 


65 


80 


65 


70 


Attitudes and aspirations 










importance of school achievement 


75 


80 


50 


60 ^ 


Self -"per caption 


70 


65 


65 


70 


Attitude toward school 


10 


5 


40 


30 


School himian resources 










Pupil/ teacher ratio 


70 


70 


30 


30 


Average yeai.'S of teaching experience 


30 


25 


5 


25 


Teachers with Itester^s degree or 










above (%) 


75 


75 


10 


15 


Average teacher salary 


90 


85 


25 


25 


School financial resources 










State equalized valuation per pupil 


90 


90 


75 


75 


Local revenue per pupil 


90 


90 


50 


50 


State school aid per pupil 


30 


30 


55 


55 


K^12 Instructional expense per pupil 


90 


90 


25 


25 


Total current operating expense 










par pupil 


90 


90 


20 


20 


Achievement 










Vocabulary 


10 


10 


40 


50 


Reading 


10 


15 


40 


60 


English expression 


10 


15 


35 


55 


Mathematics 


15 


25 


SO 


70 


Basic skills composite achlevMient 


10 


IS 


40 


55 



The percentiles indicate Grand Rapids' relative plac^ent j?lth 
respect to other Michigan school districts. In the first row, for 
example, 80 percent of all lUchlgan school districts rank below 
Grand Rapids with respect to the SES of seventh-graders , but only 
70 percent of Michigan core-city school districts rank lower. 
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college, and $644 overall The 1970-71 total operating budget was around $33 mil- 
lion. A comparative budget summary is provided in Table 3. A little over half the 
district’s revenue comes from local source, 40 percent from the state, and luost of 
the rest from tuition from students who live outside the district. 

The millage rate (i.e., the property tax rate per $1000 assessed valuation) for 
Grand .Rapids is quite low compared to other Michigan cities. In part, this reflects 
the substantial number of pupils in private schools. Perhaps it also reflects fiscal 
conservatism. In any event, millage elections have become a periodic crisis point in 
the district, and a large part of the district’s public relations efforts are devoted to 
this question. In the spring of 1970, a millage election was lost and termination 
notices were sent out to 600 teachers. A new election was held and the higher 
millage rate was passed. The 500 teachers who were still available were rehired. 

The County Allocation Board gives the schools 10.1 mills out of the 15 mills that 
is the maximum lawful levy on the populace (without elections). In addition, there 
are 14 mills that have been authorized by elections. The total 24.1 mills represents 
$17.8 million of operating funds. 

The district asked for three additional mills in the April 1971 election to cover 
increases in salaries and operating costs that were expected in the 1971-72 school 
year. The district anticipated enrollment increases as a result of the denial of state 
aid to nonpublic schools.® 

The history of millage elections is summarized in Table 4. 



THE SCHOOL OPINION SURVEY 

Despite the district’s very broad range of curricula, special programs, and com- 
munity involvement activities, the administration is sensitive to criticism from the 
community that the district is unprogressive. 

In order to obtain a clearer picture of the citizens’ viewpoint, the district hired 
a private firm to conduct the School Opinion Survey in January 1970. Five hundred 

- 

® In November 1970’s state election, Michigan voters passed Proposal C, a constitutional amendment 
that denies state aid to nonpublic schools. This overturned the legislature’s plan to pay half the salaries 
of teachers of nonreligion classes in nonpublic schools (two new nonpublic schools had opened in the fall 
of 1970 in Grand Rapids in anticipation of this s'ubsldy). The State Superintendent of Schools set the cutoff 
date for direct state aid at December 18. All of this was expected to have considerable impact in Grand 
Rapids, where 30 percent of the children go to nonpublic schools. 
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Table 3 



SUMMARY OF GRS FINAL OPERATING BUDGET FOR 1970-1971 



Item 



Revenue 

Revenue from local sources 

Tuition 

Interest 

Net revenue: revolving fundt 

Miscellaneous 

Revenue: state sources 

Revenue: state redist. Fed. funds 

Revenue: Federal sources 

Incoming transfer accounts 

Balance from previous years 

Total Revenue 



Expenditures 
Instruction 
Administration 
Attendance 
Health services 
Pupil transportation 
Operation 
Maintenance 
Fixed charges 
Capital outlay 
Coimnunlty services 
Student services 
Outgoing transfer account! 
Contingency 

Total Expenditures 



Actual 

1968-69 



$13,864,847.69 

913,961.75 

483,851.68 

8,056.68 

97,681.10 

10,340,804.98 

122,820.37 

73,949.89 

475,338.59 



$26,381,312.73 



$18,841,404.91 

700,115.62 

147,524.94 

24,763.05 

409,304.67 

2,635,817.92 

1,247,788.69 

501,734.13 

481,116.91 

221,354.52 

46,654.19 

46.685.44 



$25,304,264.99 



Budgeted 

1969-70 



$14,120,500 

1,038,450 

450.000 

82,000 

11,063,847 

100.000 
109,500 
475,000 
985,298 

$28,424,595 



$21,569,389 

773,848 

176,447 

28,285 

372,790 

2,861,381 

1,347,848 

550,050 

445,245 

210,000 

49,062 

40.250 



$28,424,595 



Final 

Budget 

1970-71 



$17,830,981 

1,332,130 

600,000 

180,083 

12,189,456 

100,000 

29,230 

307,000 



$32,568,880 



$24,824,409 

871,851 

232,104 

32,689 

475,795 

3,243,051 

1,474,667 

701,194 

307,548 

181,550 

35,260 

38,762 

150,000 

$32,568,880 



Surplus for Year 



$ 1,077,047.74 



k 
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Table 4 



GRS HISTORY OF MILLAGE ELECTIONS 







,^ount 


Funding 






Yes 


Date 


Result 


(mills) 


(No, yr) 


Yes 


No 


C%) 


4-6-64 


Defeated 


4 




18,137 


25,247 


41.8 


9-1-64 


Passed 


3 


— 


27,705 


21,011 


56.9 


4-4-66 


Passed 


3 


5,® 


12,826 


11,672 


52.3 


6-5-67 


Defeated 


5 


1° 


9,902 


12,858 


43.5 


11-21-67 


Passed 


7 


2® 


22,161 


22,106 


50.0 


2-^16-70 


Defeated 


12 


1^ 


8,882 


24,966 


26.2 


6-8-70 


Passed 


11 


1® 


23,934 


18,915 


55.9 


4-17-71 


Passed 


17 


3* 


21,487 


19,807 


52.0 



®1966-67 through 1970-71. 
^1967-68. 

°1968-69 through 1969-70. 
^1970-71. 

®1970-71. 

*1971-72 through 1973-74. 



I- 




respondents drawn at random from voting precinct lists were contacted by tele- 
phone, and another 362 persons volunteered responses to a newspaper solicitation. 
On a scale from poor to excellent, the most frequent rating given the school system 
in the telephone survey was fair. The big grievancs was busing, and the service 
characterized as most needing improvement was vocational education. Most re- 
spondents said they would vote for the current millage level, but a small majority 
would not vote for an increase. Although questions dealing with grievances and 
needed improvements were open-ended, there was no reported specific reference to 
performance contracting. A partial tally of the telephone survey results is presented 
in Table 6. The results of the newspaper survey were substantially the same, except 
that the big issues raised were student discipline and building utilization. Also, the 
attitudes toward school finance were more negative. 
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Table 5 

RESULTS OF SCHOOL OPINION SURVEY, JANUARY 1971 

Response 



Item (%) 

The Grand Rapids school system Is: 

excellent 7 

above average 25 

fair 44 

poor 9 

don't know 16 

1-Iajor areas needing Improvement: 

busing Celiinlnate) 13 

teacher quality 8 

student discipline 7 

spending Creduce) 6 

facilities (more) 5 

etc. 

Services needing Improvament: 

vocational education 31 

utilization of buildings 18 

tutoring ll 

senior citizens program 10 

etc . 

Millage elections should be held: 

each year 20 

every 3 years 40 

every 5 years 10 

makes no difference 25 

don ' t know 5 

Would vote today for present millage 

yes 67 

no 20 

undecided 13 

Would vote today for an increase if needed: 

yes 39 

no 43 

undecided is 



NOTE: The survey was conducted by a private firm. 
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GRAND RAPIDS’ INVOLVEMENT IN PERFORMANCE 
CONTRACTING 



Grand Rapids schools were not inexperienced with industry-supplied instruc- 
tional programs. Behavioral Research Laboratories had supplied the Project Read 
program to several schools on an unguaranteed basis before 1970-71, and the district 
had been pie ised with the materials. GRS also felt able to evaluate the Texarkana 
experience from an informed position. 

In the spring of 1970 an executive of the local Dyer-Ives Foundation met a WLC 
officer in New York, and became acquainted with their learning center concept. The 
executive passed the word on to district officials, suggesting that they visit the WLC 
commercial learning center in Albuquerque. Two members of the superintendent’s 
staff and one school principal visited the center in April and made positive recom- 
mendations to the Board of Education, and the Board acted in August to contract 
for learning centers in Franklin and Lexington schools. 

Over the summer, Dr. Walter Thomas, an executive of CMES who formerly 
lived in Grand Rapids, successfully solicited a contract from the district for South 
Middle School. 

Meanwhile, Grand Rapids was selected as one of the eighteen school districts 
to participate in OEO’s massive experiment in performance contracting; Alpha was 
assigned as the subcontractor for programs in West Middle, Alexander, and Hall 
Schools. 

In September, Grand Rapids accordingly found itself in the unique position of 
housing three performance contracts in academic subjects. 

The WLC and CMES contracts were let on a sole-source basis, while Alpha won 
its position in a competition-bid process. Other educational firms were quick to 
criticize the sole-source aspect of the non-OEO contracts. 

District A dmi n i stration of the Programs 

Three successive GRS chief executives played key roles in the performance 
contracts for 1970-71. Dr. Norman Weinheimer was Superintendent during the 
conceptual and initial negotiation phases. When Weinheimer left in August 1970 to 
become Executive Director of the Michigan School Board Association, Dr. Robert 
Muth became Acting Superintendent. Muth was in command during final contract 
negotiations and the first three months of operation. In December, Mr. Philip Run- 




kle took over as Superintendent, and saw the year to completion. The terms of the 
three men correspond roughly with the negotiation, startup, and contraet-comple- 
tion phases of the programs. 

Administration of the WLC and CMES contracts was the responsibility of Dr. 
Elmer Vruggink, .Assistant Superintendent for Instruction. Vruggink monitored the 
CMES program through Mrs. Mary Edmond, Assistant Principal at South Middle 
School. The WLC contract was monitored through Richard Bandy, an Assistant 
Director of Elementary Schools, who in turn depended on Thomas Jackson and 
William Kirkwood, principals at Franklin and Lexington Schools, respectively. Ad- 
ministration of the Alpha program was the responsibility of Mrs. Joan Webster, 
local Director of OEO Contract Learning. Although Mrs. Webster’s salary came 
from OEO, she was a district employee. 

Day-to-day operation was the responsibility of the contractors on-site manag- 
ers, subject to the authority of the respective building principals. District officials 
became involved only when problems could not be settled at the building level. 

The Teachers’ Union and Performanc© Contracting 

Since 1965, Michigan has had legislation authorizing collective bargaining by 
teachers with school districts. GRS has a contract with the Grand Rapids Educa- 
tional Association (GREA). GREA’s Executive Director, David L. Thompson, is gen- 
erally favorable toward performance contracting. He regards the accountabiiiity 
features as conducive to improving professionalism within the teaching ranks. He 
is adamant, however, that the GREA should be involved in any aspects of perform- 
S ance contracting that touch on its contract with the district. This position has raised 

1 a number of issues regarding Grand Rapids’ contract learning. In particular, it has 

i caused some disagreement over the prospect of extra compensation for teachers in 

the performance-contracted programs. Thompson feels that any additional compen- 
sation must be negotiated. 

The master contract between the school board and the union provides that 
GREA be involved in any decision that involves a change in pay or conditions of 
work. There was a possibility of bonuses for some of the teachers.^ Thompson’s view 

' At the beginning of the 1970-71 school year, Alpha indicated that incentive money would be 
available for teams that did welh $700 for each teacher and $400 for the aides. CMES did not indicate 
any amount; it said some money would be available if teams did well and if the money were available 
after the expenses had been met. The WLC program was not involved since there were no incentives to 
- be paid to teachein (and the two Westinghouse Learning Center teachera were very supportive of the WLC 

program), 

'■ 

1 
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was that any bonus would violate the first clause in the Union’s contract, which 
states that there will be no changes without regotiation with the union. Vruggink’s 
opinion as of September 1970 was that the district was adhering to the contract by 
virtue of the facts that all teachers in the performance-contracted programs were 
on the district payroll, and the district was paying them exactly what the GREA- 
GRS contract requi ’ ed; he took the position that if any of the corporations provided 
additional payments or changed the conditions of work, that would be a matter for 
the contractors to work out with the union. The issue appeared to be whether the 
district can unilaterally step aside and let contractors take its place at the bargain- 
ing table. 

This issue is a matter of principle to GREA. Thompson stated that the union is 
willing to be very reasonable about compensation, but he feels the union has a right 
to be involved In any decisions. As he stated his position in thj fall: "We have an 
agreement which must be followed. If the Board enters into a unilateral arrange- 
ment, it will violate the first article of our agreement. The union wants to be 
involved. It’s an experimental program that we are willing to go along with; how- 
ever, if we are not involved we are going to court.”® 

This matter came to a head in early May 1971, when Thompson lodged a formal 
grievance that Alpha had been compensating teachers beyond the terms of the 
master contract. GREA demanded that Alpha be financially penalized and that 
Alpha’s on-site director and OEO’s Contract Learning Project director be fired. 
Otherwise, GREA wanted all city teachers to draw the same bonus from tax sources. 
In May, GREA and Superintendent Runkle agreed that contractors would have to 
abide by the master contract and not award incentive pay unless cleared through 
the instructional council, composed of teachers and administrators (Alpha was not 
consulted in the agreement). GREA withdrew its previous demands. 

The Superintendent acted to prevent the grievance from coming before the 
Board of Education, where it might have developed into a nationwide test case on 
unnegotiated bonuses. 

In spite of the controversy, GREA was maintaining a positive stance toward 
performance contracting at tht, end of the school year. In conversation, one GREA 
oflficial remarked: "For once, things are rotating around the kids’ learning instead 
of around administration or teachers,” In GREA’s view, the main problems with 
regard to harmony between performance contracts and the master contract are 

® The GREA is not afraid to go to court. In 1969, the union spent $2y,000 in arbitration over a SBO 
item involving wages withheld from a teacher who took a day off to observe a rellgioui holiday. 



difTerentiated stafling and the relation of learning center personnel salaries to those 
of regular staff, and it wants to be involved in these decisions. GRS, naturally, seeks 
to avoid a third party to its negotiations with contractors. 
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III. THE WESTINGHOUSE LEARNING CENTER 
CONTRACT LEARNING PROGRAM 



PROFILE OF FRANKLIN AND LEXINGTON SCHOOLS 

Franklin and Lexington elementary schools are both in the inner city (see Fig. 
2); Franklin is black, and Lexington is white. Each has about 250 pupils, one-third 
of whom are preschool, kindergarten, and special-education. They are both Title I 
schools; Franklin also receives Michigan Section 3 money. The attendance areas of 
both schools serve medium- to low-income families. Student turnover for both 
schools was about one-third during the 1969-70 school year. Figure 3 charts attend- 
ance for two consecutive years. These are attendance figures for the fourth Friday 
of each month, and may, therefore, give a biased picture (for example, the fourth 
Friday of October 1970 was probably the date for Halloween programs). The waters 
are also muddied by the inclusion of special-ed, kindergarten, and preschool pupils. 



THE WLC FORMAT 

The research behind WLC*s program began in 1966. WLC’s intent was to create 
a comprehensive environment consisting of a motivational system, self-instructional 
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Fig. 2— WLC Programs: Franklin and Lexington Schools 





18 





Fig. 3— Attendance at Franklin and Lexington Schools 

(fourth Fridays) 



materials, and a continuous curriculum designed to meet the needs of the individual 
child in the reading and math skill areas. 

WLC has operated a commercial Learning Center in Albuquerque, N ew Mexico, 
since 1967, where parents can contract with the Learning Center for their children’s 
achievement in mathematics and reading. The commercial center operates on a 
guaranteed performance basis whereby parents pay only for achievement realized 
according to nationally standardized tests. In 1970-71, WLC introduced its learning 
center concept into public and private schools; it participated in the OEO experi- 
ment and ran an independently contracted center in Gilroy, California (see Vol. 5 
of this series). WLC characterizes the learning center "concept” as being built upon 
four elements: (1) curriculum, (2) materials, (3) motivation, and (4) self-management. 
These are discussed below. 

Curriculum 

A basic skills curriculum was established with the idea of creating a continuum 
of individual yet interdependent areas of concentration. Appioximately 200 
modules for reading and 176 for math were identified as necessary for a meaningful 
learning experience through levels one ’to nine. The module is the unit of study for 
a particular skill, and there are from 8 to 66 lessons per module. 
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The basic element in the Learning Center Program is the diagnostic approach 
for determining individual skill deficiencies. A series of diagnostic test instruments 
have been developed for the respective instructional levels in reading and math- 
ematics. Item analysis is performed on the diagnostic test, leading to a prescription 
for the particular skill deficiencies in the child’s capabilities. 

A teletype has been installed on which periodic diagnostic information is 
relayed to a central computer in Albuquerque, and through which instructional 
patterns for individual students are returned for implementation within the class- 
room. 



Materials 

The materials used to teach the modules in the individual prescriptions are, for 
the most part, commercially available, programmed, and self-instructional. No sin- 
gle publisher’s program is emphasized; the materials have been selected from 25 
separate publishers. WLC has developed its own materials for areas in which it 
believes suitable materials for individualized instruction have not been available. In 
some cases, one company’s materials are used throughout an entire module, in 
others, those of several companies are blended. 

Cassette tape recorders are the only instructional hardware in the Grand Rap- 
ids program. For a time. Bell & Howell Language Masters were used to develop 
reading skills in the Beginning Reading Program, but that part of the program later 
returned to a more conventional small-group instruction approach in order to incor- 
porate verbal interactive effects into this part of the curriculum. When the Franklin 
and Lexington learning centers are turnkeyed,® the equipment will be turned over 
to the district for cost less depreciation. 

Motivatioii 

The primary motivation tool is contingency contracting. Pupils, with staff as- 
sistance, contract to do one or more lessons, upon completion of which they receive 
a "buzz break” to engage in some specified activity. The activity area is adjacent to, 

* In performance contract jargon, turnkey occurs when the contracted learning system or its tech- 
nology is Incorporated into the regular school curriculum. 




but separate from, the learning area, and contains toys, games, and books. One 
"buzz” equals five minutes. 

Other behavior modification techniques are also employed. Faced with the need 
to have children cooperate and behave in a fashion that will help them learn, the 
learning center has adopted a point system for rewarding good behavior instead of 
punishing the bad. In the early stages of a center’s operation, points are redeemable 
by local candy stores and toy shops. Once the desired patterns of behavior have 
become reinforced, WLC claims that the need for immediate reward diminishes, and 
can be replaced by internal rewards.^ WLC personnel emphasize that rewards are 
based on "subjective e^ iluation, not success.” 

Self-Manageiiient 

The object of self-management (independent learning) is to enable the child to 
develop a sense of maturity and familiarity with the system so that he can control 
his own learning experience. Four levels of student-teacher contracting are used to 
identify the different plateaus of maturity and independence. The levels flow from 
the totally dependent youngster requiring complete staff involvement to the in- 
dependent child who is able to manage his own program except for checking module 
pre- and post-tests. 

The level-one child, dependent upon staff for managing his program, is told how 
many lessons he is to do at a sitting and the number of buzz breaks in the activity 
room he will earn, receives suggestions for certain activities, and has each lesson 
checked by a staff member. At level-four contracting, the child selects the lessons 
to be done, the number of buzz breaks to be earned, and the activity in which he will 
participate. He also checks his own lessons. 



WLC AT FRANKLIN AND LEXINGTON 

The original intent of GRS was to bring pupils from all over the district into the 
learning center, but considering the modest success of their five years of Title I 
projects, the planners decided to zero in on two schools to try to obtain a noticeable 

- As will be noted later, some GRS teachers feel that this did not happen in Grand Rapids. 






impact. This concentration of effort also figured in the goal of bringing students up 
to grade level: it was a simple goal that the entire community was likely to under- 
stand. As discussed previously, G^S has had trouble selling budgets to the taxpay- 
ers, and the district would like some simple and understandable successes to talk 
about, 

Mr. Jack Goldberg, WLG’s Learning Genter Manager, operated both centers. 
Goldberg also was the consultant on the two 'Turnkey” centers (to be discussed 
later). He felt that one WLC manager (or consultant) for five learning centers would 
be about the optimum ratio. 

There was one district-paid program teacher in each learning center. WLC 
hired the aides. The principals were made responsible for the progress of the pro- 
grams, and Mr. Richard Bandy, Assistant Director of Elementary Schools, served as 
liaison with the Board of Education. Goldberg and the principals tried to handle 
problems at the local level, but came to Bandy if necessary. 

Prior to the opening of the learning center, a week of training was provided for 
all teachers in the schools. Also, an orientation program was conducted on a weekly 
basis for the school staff to familiarize them with the learning center on successive 
Friday mornings for eight weeks beginning on September 18. 

The September enrollment was 220 pupils, all enrolled in both math and read- 
ing. Two were withdrawn from the program by December for behavioral reasons. 
The schools changed their teaching format somewhat so that there was no reading 
and math instruction in the regular classrooms when learning center participants 
were present. Each teacher spent at least one hour a week in the WLC classroom, 
and team teaching took up the slack. 



Second-Semester Modifications 

On January 25, the format of the learning centers (Lexington and Franklin 
schools) was modified to accommodate all students except special-education, kinder- 
garten, and preschool. The change came with the observation that the 2-1/4-hour 
sessions were too long to maintain the attention of the lower primary students. 
Before the change, selected first- to third-graders were in the centers in the morning, 
and fourth- to sixth-graders in the afternoon. After the change, there was one 
76-minute morning session for first- and fourth-graders, and one for second- and 
third-graders. Fifth- and sixth-graders had a full 2-1/4-hour afternoon session. 

The classroom teachers became more involved than before in the operation of 
the program, both within the learning center and in the classrooms. The teachers 



for the fifth- and siKth-grade children operated a satellite prograi that renioved 
from six to ten children at a time from the learning center to provide for oral 
reading, enrichment, and any other activities considered appropriate. This satellite 
arrangement allowed each child in the learning center to participate in a group 
activity for about one hour a week. The teachers for the first through the fourth 
grades, in addition to I'l’^ctioning in the center, had groups of children in their 
classrooms for purposes of group instruction, specifically providing for verbal re- 
sponses in the Basal Reading Series. It was found that their being out of the learning 
center proper provided a more conducive atmosphere for this type of verbal activity. 
These teachers, particularly the first- and second-grade instructors, were also 
obliged to spend some time in the afternoon reinforcing those skills learned as a part 
of the learning center program, using flash cards, word lists, and so forth; otherwise, 
the 76 minutes of reading and math would have fallen short of the minimum 
required under state law. 

There were parent conferences in November and March. A written report went 
home the first week of June. 

Contract Provisions 

The contract between GRS and WLC (see Appendix D) was almost the same as 
the one between Gilroy and WLC; one major difference was that the Gilroy contract 
had a sliding payment provision and the GRS contract did not. The standard fee in 
Grand Rapids was $149.60 for each achievement-year recorded by each student in 
the program; if any student failed to accomplish at least one achievement-year in 
a subject in 120 hours of study, the school was to pay nothing for his instruction. 
The fee arrangement was negotiated at the superintendent level. The district made 
progress payments, which were computed by WLC’s New York office on the basis of 
80 percent of estimated performance to date. 

A pupil was to be cycled out of the program when he completed his prescribed 
instruction modules, a process expected to vary from three to nine months. If he did 
not meet his exit objective (according to the MAT post-test), he was to be retained 
in the same program with same goal. Variable exit provided no problem to stabiliz- 
ing class sizes, thanks to flexible teacher scheduling. The individual exit objectives, 
all of which exceeded one year of achievement gain, were derived from the diagnos- 
tic testing and the MAT pre-tests. In terms of gain, all objectives exceeded one year. 
The sum of the exit objectives for all students was 960 achievement-years. Accord- 
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ingly, the maximum payment on the contract was the product of $149.50 times 960, 
or about $144,000. 

The second-semester program modifications also affected contract provisions 
somewhat. The contracted total learning objectives of 960 achievement years re- 
mained fixed, but all students were to remain in the program until the end of the 
school year, rr'o-ardless of when individual student objectives were reached. Since all 
students were pre-tested in September, baseline grade levels for students entering 
the program at the time of the midyear reorganization were arbitrarily set by adding 
four months to the pre-test scores. 

According to Bandy, it was not realistic (or all that necessary) to insert flexibil- 
ity into the contract that would protect GRS and the students if the program did not 
produce. It is hard to determine whether a program is foundering until the end of 
the year, but the principals and Bandy were monitoring to pi^otect the pupils’ 
interests. The GRS preplanning research was extensive, and there was nothing in 
the WLC program that, in their judgment, conflicted with the GRS philosophy of 
instruction (individualized instruction, contingency m.anagement, technical hard- 
ware, etc.). WLC had to fit into the district’s format, and was "not running the two 
schools.” 



Individual Exit Objectives 

The individual exit objectives were derived by WLC in some unspecified way 
from the MAT and the diagnostic testing. Those for the upper grades exhibited 
curious characteristics. Figure 4 depicts the joint distributions of baseline scores 
(MAT pre-test) and exit objectives for fifth- and sixth-graders for Franklin School. 
One might expect to find the gain objective to be higher for low-baseline pupils in 
order to cash in on the regrossion-to-the-mean effect and the fact that many low- 
achievers may simply be undermotivated; these factors would be accommodated by 
having the exit objective approach a single score, but instead they seem to have 
overcompensated. It appears that the lower the baseline score, the higher the ex- 
pected exiting score — as if the underlying premise is that low-achievers have high 
intellectual capacity and the learning center will realize that capacity. Another way 
of viewing the relationship between objectives and baseline scores is illustrated in 
Fig. 5, which plots the gain objectives versus baseline for Franklin. In this graph, 
regression-to-the-mean would be accommodated by setting the slope somewhere 
between zero and minus 1:1 (i.e,, 46 degrees downward); but here the slopes are 
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Fig. 4— Joint distributions of exit objective and baseline score, 

Franklin School, grades 6-6 

actually steeper. The close linear relationship for the fifth and sixth grades dispels 
the notion of a complex tbrmula for determining objectives, so it seems that the 
overcompensating objectives were deliberate. 



Testing 

Contract-specified pre-testing took place on September 3 and 4 (with some 
makeup on September 8). Post-tests were administered the first week of June. The 
tests were all Metropolitan Achievement Tests using (1) reading readiness for those 
who had been in kindergarten the-previous year, (2) the primary II battery, (3) the 
elementary battery, and (4) the intermediate battery. Pre- and post-tests were the 
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Fig. 5— Gain objectives vs. baseline scores, 
Franklin School, grades 2-6 






3 ^ ■ 



A and B forms, respectively. The district secs its baseline data in math and reading 
by a simple average of the appropriate subtests in the pre-test battery (e.g., reason- 
ing, vocabulary, etc.). At the end of the year, the district reported that pupils who 
had been pre-tested totaled 208 for Franklin and 198 for Lexington; these totals 
included special-education pupils, only a few of whom were included in the learning 
center program. 

One problem of concern to Bandy was that the reading readiness test d oes not 
provide the grade equivalents that are used as baseline data. The tests ai e graded 
from A to E, which the test manual translates to a grade expectancy as of the end 
of the school year. Since, in this case, the contract payment formula called for an 
entering grade level, GRS and WLC were still trying to agree in September on what 
grade equivalent to assign to the respective letter grades. They finally arrived at the 
following: 



Reading 

Readiness 

Score 


Assigned 

Grade 

Equivalent 


A 


1.0 


B 


0.8 


C 


0.6 


D 


0.4 


E 


0.2 



Gains in Reading and Math 

The average grade equivalent gains between pre-tests and post-tests were as 
follows: 



1 School 


Reading 


Math 


Number 

Post- Average 

tested Gain 


Number 

Post- Average 

tested Gain 


Franklin 

Lexington 


168 0.68 

177 0.74 


157 0.67 

176 0.69 


Both schools 


336 0.66 


333 0.58 
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The above gain statistics are based on a mixed group of full-year participants and 
half-year participants; the following averages include only those students who at- 
tended the learning centers at least 150 days: 



Reading Math 





Nurtben 




RwrtoeT 






Post- 


AveTage 


Pos t- 


Avenge 




tea ted 


Gain 


tes ted 


Gain 


Franklin 


61 


0.67 


60 


0.57 


Lexington 


80 


0.67 


79 


0.59 


Both schools 


141 


0.67 


139 


0.58 



To determine which students achieved one year’s growth, it was necessary to 
adjust gains to account for those v/ho attended for less than the full year. Accord- 
ingly, adjustments were made for those who attended less than 160 days, or roughly 
three-fourths of all participants. The district came up with a formula that did this, 
and labeled the result "equated grade gain.” If a student’s equated grade gain was 
greater than 1.0, he was to be a factor in payment; pay ment itself presumably would 
be on the basis of actual grade gain. The numbers eligible for payment according to 
this formula were: 



Reading Math 

Franklin 69 44% 54 34% 

Lerington 90 51% 56 32% 



As of August 1, 1971, WLC had not indicated their agreement Nvith the district .j 
formulation. 

Table 6 divides the students into groups according to the number of days in 
attendance in the learning centers. Actual grade gains and equated grade gains are 
shown for each group. The table shows that equated grade gain can be misleading 
if used for performance comparisons. For example, the math equated grade gain for 
Franklin is much higher than that for Lexington. Closer examination shows that the 
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Table 6 

GRADE GAIN RESULTS 
Westlnghouse Learning Systenis, Inc, 




¥i:. 




No . of 
Students 


Days 

Attended 


Reading ( 


Srade Gain 


Hath Grade Gain 


Actual 


Equated 


Actual 


Equated 


Franklin School 


42 


160+ 


28.4 


28.4 


23.2 


23.2 


30 


140-159 


14.1 


16.9 


21.7 


26.0 


10 


120-139 


8.4 


11.6 


6.0 


8.3 


6 


100-119 


5.0 


8.2 


7.0 


11.4 


31 


80-99 


18.7 


37.4 


10.5 


21.0 


31 


60-79 


8.9 


22.9 


8.8 


22.6 


19 


4J-59 


2.7 


9.7 


3.8 


13.9 


20 


20-39 


1.3 


7.8 


2.6 


15.6 


19 


0-19 


3.7 


66.6 


5.4 


97,2 


Total 208® 




91.2 


209.5 


89.0 


239.2 


Average 




0.577 


1.33 


0.566 


1.52 




Lexington Set 


lopl 






50 


160+ 


33.9 


33.9 


33.0 


33.0 


43 


140-159 


28.7 


34.4 


19.6 


23.5 


11 


120-139 


8.5 


11.7 


5.4 


7.5 


3 


100-119 


2.5 


4.1 


1.9 


3.1 


44 


80-99 


34.9 


69.8 


25.3 


50.6 


26 


60-79 


19.4 


49.9 


14.7 


37.8 


4 


40-59 


3.8 


13.7 


3.1 


11.1 


4 


20-39 


0 


0 


0 


0 


13 


0-19 


0 


0 


0 


0 


Total 198^ 




131.7 


217.5 


103,0 


166.6 


Average 




0.744 


1.23 


0.585 


0.947 



SOURCE; GRS Special Programs Office. 



®208 students were assigned to the 
reading and 51 math students were not 
These were not used in cttlculatlon of 
gain. 

^198 students were assigned to the 
reading and 22 math students were not 
These were not used In ciilculatlon of 
gain. 



Franklin School Program. 50 
tested for final gain results, 
grade gains and average grade 

Lexington School Program. 21 
tested for final gain results . 
grade gains and average grade 
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difference is caused by those students at Franklin with the lowest attendance. 
Nineteen students with a combined total of only 5.4 actual grade gains contributed 
97.2 equated grade gains; the small actual grade gain could have been entirely the 
result of test error or maturation. 



Other Student Data 

At Franklin School student files were examined by the author to obtain in- 
dividual student data on "working habits,” tardiness, absen'^e, and learning steps 
(in reading, spelling, English, and handwriting). These data were taken from Con- 
tinuous Progress report cards for November 1969, for June and November 1970, and 
for June 1971. About 20 percent of the files were missing. 

The assignment of learning steps within each reporting period for each grade 
was found to be disappointingly uniform. Either the students progressed at an 
unusually uniform rate or were being handed convenience grades.® The latter is 
probably more accurate, since the baseline scoies indicate a wider dispersion of 
achievement. In either case, a rating scheme that is weak in discriminating among 
different levels of performance seems unlikely to provide useful indications of pro- 
gram performance. 

Distributions of work habits, tardiness, and absences were briefly analyzed. 
Work habits for the second, third, and sixth grades appeared to be systematically 
poor for the original participants; work habits for nonparticipants are more evenly 
distributed. The original participants appear to have had a more pronounced history 
of tardiness and absence than the others, a trend that reversed for the first three 
months before all students were brought into the center. 

Summary of Resources and Program Characteristics 

Table 7 provides a rough summary of resources that are directly identifiable to 
the learning center at Franklin School (it excludes, for example, building mainte- 
nance, heating, and district overhead items). 



- A student’s learning step generally depends on his progress through the textbooks, which suggests 
that students generally progress together. 
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Table 7 



SUMdARY OF RESOURCES MD PROGRAM CHARACTERISTICS 
FOR WESTINGHOUSE LEARNING COIIPORATION 

Franklin School 



ChavaoteTistioB of Btudents ^ * » , * * 


Grades 1-6; inner=-city black; low income; 
tranetency 30%; lowest achievers for first 
5 months,^ then entire bchool (eKcluding 
most special education students) 


Program SQOp& 

Instruction * . 

Number of studanti 

Olnss trine *••«•>••••••••••••«•• 


Reading and math 

Initially luOj later 150 (as of February) 
Initially 2=1/4 hr, later reduced to 75 min 
for grades 1-4^ 


Class sl^a 

Nimber of sections « 


45=55 tmaximum at 60) 

3 (1 each for grades 1 and 4| 2 and 5^ 
3 and 6) 


FaGilit%B8 

Space 

S tuden t s / classr oom/ day 

Furnishings^ . ^ ^ ^ . 


2 regular classrooms 
75 

30 carrels and ehalrai with electric out= 
lets at each carrel; 7 tables, 21 chairs; 

3 bookshelf-cabinets; carpeting 


Staffing 

Certified teachers 

Special teachers 
Faraprof es s ionals 
Other personnel 


1 (no planning time required)^ 
None® 

2, on 6=hour day 

On=slte director &nd secretary 


E^piipm&nt 

Telex 

Cassette tape recorders. 


if 

30B 


Mcztortct %B 


BEL modern math texts; large variety of 
other materials^ 


Pr&~Bmrvia0 training, • 


5 days for all teachers of school 


In^&mrviae training 


8 morning meetings for entire staff 


Other support 


None 


InaentiveB 


None 



For footnotes, see following page 



Tab.i e 7~aontinu&d 

In January s all students were brought into the program so that sessions 
for grades 1--4 could be shortened by one=half, 

^Slnce 75 minutes does not satisfy state requirements for reading and 
math instructior , teachers provided reinforcement y.eading and math in 
the regulai; classrooms, 

C- 

The district had about a month to arrange space and install furnishings, 
which was sufficient time for this particular program, 

d 

Regular teachers accompanied their pupils to the learning centers. 

^The regular remedial teacher was reduced to half-times and much of her 
time was subsequently spent in testing. 

^The one Telex served four learning centers; installation was simple 
since it transmits via telephone, 

fi- 

- Tables and chairs were used about evenly for reading and math. ^ ^ 

The materials are listed in Appendix C, Consmiable materials cost 
about $5 per pupil. 



YEAR-END COMMENTS FROM STAFF AND PARENTS 

In order to elicit a variety of views of the WLC programj informal interviows 
were obtained from the orincipals and WLC learning supervisors from each school, 
one regular teacher froi Lexington, two regular teachers from Franklin, and five 
parents of Franklin students. Although regular teachers were arbitrarily selected 
from staff rosters, their comments should not be regarded as reflecting prevailing 
attitudes since only three responded. Two teachers were contacted from each school, 
but one from Lexington School was too busy to comment. Similarly, caution should 
be taken in interpreting the remarks of the five parents. Nonetheless, the views are 
instructive.® 



Lexington School Principal 

According to Principal William Kirkwood, who was also chairman of the dis- 
trict Contract Programs Committee, most of the Lexington staff were sympathetic 

* A broader view might be obtained from the Interim Report to the Board of Education (Appendix A) 
and the recommendationa of the Contract Program Committee (Appendix B). 
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from the beginning. As late as December^ however, two teachers still felt their 
regular classrooms were just as effective; but by the end of the year they apparentl> 
no longer felt threatened, and viewed the center as a useful aid to their own instruc- 
tional programs. The decisive factor in winning over the teachers seems to have been 
the midyear reorganization. Before, the teachers spent an hour per week in the 
centers, but there seemed to be a definite separation between the Westinghouse 
program and the 'regular” program. After the reorganization, teachers were in and 
out of the centers with their classes every day, and more closely coordinated their 
instruction with the centers. 

In Kirkwood’s opinion, "The companies have something valuable to oifcT, but 
it doesn’t have to be performance contracted— it’s just that this seems to be the only 
way they can get into the schools.” After the companies have established their 
reputations, Kirkwood expects that they will simply sell their services without 
performance guarantees, as -iv Sibley and Straight schools. 

He likes what he sees, especially the individualized instruction and the diagnos- 
tic and prescriptive services. He would recommend that next year the first-year 
students be phased in after they have received "proper classroom foundation,” since 
it takes them a while to catch on to the self-sufficiency aspects. Westinghouse ac- 
knowledges that the program is not quite ready for pupils just out of kindergarten. 

The students seem to be performing better; at least everybody is always work- 
ing, and there are no student complaints. They seem to enjoy the program. In 
Kirkwood’s opinion they enjoy not so much the contingency management as "doing 
their own thing.” Some of the newer upper-grade students who entered after the 
reorganization are into geometry, and teachers are having to take textbooks home 
at night so they can review. 

There are still some behavior problems, but this is not necessarily a reflection 
of attitudes toward school. Kirkwood does not think there is any easy way to change 
attitudes. 

Kirkwood administered a questionnaire to 100 parents at midyear. The only 
negative finding was that parents think they should be more fully informed. 

The PTA is weak, Kirkwood points out. Too few parents are interested enough 
to maintain monthly meetings^ — they tried that last fall and about four parents 
came. They do have a PTA board, and they put on a few functions during the year 
(carnival, Christmas program, open house, etc.) that attract parents. Parents are 
very concerned about grades, but even after three or four years they still do not 
understand the grading system of the Continuous Progress Program (GRS’s un» 
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graded system for alementary schools). They want to be able to compare their 
children, and the system frustrates them; the Westinghouse reporting system (crit- 
erion-referenced with nothing to compare by) is even more frustrating. 

Kirkwood’s involvement with the program began last April, when he accom- 
panied Miss Ina Lovell, Director of Elementary Schools, and Bandy to Albuquerque 
to look over WLC’s commercial center for a day. They recommended to the school 
board that Grand Rapids should contract with WLC. The board finally decided in 
August, and Lexington and Franklin schools were chosen. 

He put in a great deal of extra time because of the center, but he feels he would 
not have had to if he had chosen to avert his eyes from its growing pains. During 
the year, he usually spent an hour a day in the center working with the students, 
and he often accompanied Goldberg on speaking engagements to explain the system. 
There were numerous reports to be written. 

There were no conflicts of authority. Kirkwood ran the school, and together 
with the on-site manager, he ran the center. The manager looked to KirKwood for 
decisions. Kirkwood thi.iks sheer attitude is at the heart of the matter; problems 
could arise if roles were misunderstood and the two did not get along. 

"i. 

Lexington School Learning Supervisor 

The Learning Supervisor at Lexington School regards her role as exciting, but 
more physically and emotionally demanding than regular teaching. She had to 
rearrange her goals somewhat so as to emphasize management skills. Not as much 
outside preparation is required, but effort in the c’assroom is much more intense. 

She views the learning sonter as a skill program that must be supplemented by 
outside enrichment. Even after the midyear revision, the learning center was some- 
what more isolated from the regular program than the staff would like. 

The pupil participants seemed pleased to work under less teacher pressure, and 
she felt they exhibited considerable growth in self-reliance. 

Lexington School Regular Staff Member 

This teacher felt that the self-pride of pupils in the learning center benefited 
greatly from the deemphasis of interpupil comparison. She would like to incorporate 
some of the individualized instruction into her own classroom but would need at 
least one aide. 



She felt that one year is too short a trial to tell the worth of the program. Like 
so many programs originally designed to benefit the slower students, the learning 
center seemed really to benefit the fast ones. 

She is happy that WLC realized that their learning center is really a skills 
center, and that pupils suffer if there is no oral reading or math review. In the 
learning center, there was often no time to explore questions to a point of under^ 
standing; the machines talk but do not interact, and individual students were some- 
times stopped by the vocabulary of the materials. The problems were generally 
alleviated after the midyear changes, but in some cases at the cost of other subject 
areas. In her classroom, she had to take time off from music and gym in order to 
provide reinforcement in reading and math. 

The contingency management system causes difficulty with some students be- 
cause they want to be paid in other classes and at home. Next year, the school will 
be more careful about rewarding students who perform; this year, the students 
learned quickly that they would be rewarded if they merely locked busy. 

Franklin School Principal 

In the beginning, Thomas Jackson anticipated problems of staff orientation, 
and of securing their support. Many of the Franklin staff were dubious because of 
previous unpleasant experiences with experimental programs, but at the end of the 
school year they were mostly in favor of the program. He observed positive attitude 
changes on the part of the students. Three sets of parents were very concerned at 
first, but were later supportive. Several open houses have been held to explain the 
program. His own involvement began when he was informed of the program one 
week before the end of summer. He was given 1-1/2 days of in-service administration 
preparation. The program made his job larger because it was a continual learning 
experience; the give-and-take of how best to make the centers integral to the school 
was a continual process. The center gererated the need for many large and small 
meetings. 

There was no confusion of authority at Franklin; the principal was in command, 
and he knew the contract. Jackson would like to see the center continued, but 
modified by reducing the upper-grade sessions by one-half so that the center can be 
used more efrectively and flexibly with a larger number of classes. 
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Franklin School Learning Supervisor 

She enjoyed her position, but does not think that ail teachers would want to be 
learning supervisors; attitudes and personal goals, as well as certain skills, play 
more important roles than in regular teaching. 

The one week of pre-service training by the on-site manager was appropriate for 
the needs of the job. She did not know whecher the actual operation of the learning 
center conformed to WLC expectations (contingency management, pupil self-man- 
agement, etc.), and had no recommendations about how the program might be 
modified for next year. 



Franklin School Regular Staflf Members 

Both of the regular teachers contacted from Franklin School had much to say 
about the WLC r.rogram. 

They were divided in their opinions as to whether there had been pervasive 
influence on scholarship and attitudes outside the learning center, but both re- 
garded the center as an invaluable skills-builder in reading and math. They would 
like similar capabilities for individualized prescriptive teaching in their own class- 
rooms, but this would require additional manpower. They feel that about one-fourth 
of the pupils do not respond well to individualized activities and that the first two 
grades generally do not handle the program very well ("some of the first graders are 
still lost after being there all year”). 

They were impressed with the physical set-up, especially the separate study and 
activity areas. One commented that it was too crowded end too noisy; there should 
be a noise baflfle between the activity and instruction areas, and acoustical tile on 
the ceilings. 

The technology and materials assembled by WLC were impressive. The contin- 
gency management arrangement worked well, but one teacher denied that there 
was any decrease in pupils’ reliance on the activity room. "At the end, the kids who 
needed it were the same who needed it first.” 

Both felt the goal of student self-management was not realized. They doubted 
that there was much progress toward self-sufficiency by the end of the year. There 
was not enough time for the learning supervisor to involve students in the planning 
of individual study contracts until after January, when the regular staflf were given 
more time to work in the learning center; even then, more than five minutes plan- 




36 







ning time per pupil was rare. In any case, one of the respondents doubted whether 
students really want to program themselves. The respondents’ comments were un- 
doubtedly tempered by their resentment toward boastful reports of the center’s 
superiority over regular instruction. They claim that the input of regular staff on 
questions of policy was ignored. Even after the January revision toward more coop- 
eration between the center and the regular programs, there was much Iriction 
between regular staff and learning center management. One respondent also felt 
that the regular staff had very little input to the evaluation of the Contract Pro- 
grams Committee. 

Both respondents would like to be learning supervisors, but would insist on 
realistic program objectives and different management ground rujes. 

.Frankiin School Parents 

Ten parents were selected from the Franklin School Master Card Listing, and 
telephone contact was successful with five; four had heard of the learning center, 
but knew very little about its purpose. None knew of any other parents with children 
in the center. The individual comments are summarized below: 

Parent A, Two other children were enrolled at Franklin, one in special-educa- 
tion and the other a first-grader who went into the learning center after January. 
As far as she knew, her child was not in it, and she did not know any parents who 
did have children in it. 

Parent B. She really didn’t know anything about it. Her son was in the center 
and she thinks he liked it. 

Parent C. His children were in the center. He thinks that anything for the 
children is a good thing and should be continued. "Children must like it because they 
are participating. Social activity is good for children.” 

Parent D. She said her chiidren were not in the center and she doesn’t know 
anything about it. Her children had talked about it, and they liked it. She doesn’t 
know anyone with children in the center. 

Parent E. Her son was in Project Headstart, and she had no children in the 
learning center. She had a first-grader in Alpha at Hall. She had visited a couple 
of times, and really liked it. Her child really liked it. Her big complaint was that 
the children should not be given tokens: "They learn that they’re supposed to get 
a reward every time they do something, and life isn’t like that.” Other mothers agree 
with her. She thinks it has helped her child— at least that’s what an aide told her. 



Besides, the children discovered that the tokens fit the gumball machines, so there 
had been a rash of empty machines in her neighborhooa. 



NONGUARANTEED LEARNING CENTERS 

The goal of WLC (as characterized by Goldberg at the beginning of the school 
year) is to establish and operate learning centers in school settings for about one 
year, turnkey them, then provide prescriptive and ongoing consultation services. It 
did not have to wait a year in Grand Rapids. Two elementary schools. Straight and 
Sibley, decided midway in the school year to implement WLC learning centers of 
their own, using funds arriving late through Section 3 of the State Aid Act. GRS 
bought the WLC prescriptive service, the appropriate materials and equipment and 
furnishings. They used their ovm stafl', but received consultative services from jC 
(namely, from Goldberg). There was no performance contract w*ih WLC; a flai. *ate 
payment was negotiated. Since the learning center in Straight School was one of the 
control groups for the Alpha project, only grades four, five, and six in that school 
participated. 

The initiative came from the school staffs. Vruggink insisted that the learning 
centers be installed with no increase in present staff; in order to have more money 
for the learning center, one principal went one step further and did not replace a 
teacher who was leaving. According to Vruggink, this represen ls a reversal of the 
recent trend in Grand Rapids administrators to accommodate teachers’ promises of 
more achievement in return for smaller classes. 

In January, the new learning centers at Sibley (200 students) and Straight (all 
110 upper elementary students) became operable. There were some personnel 
changes at Lexington to accommodate the new centers; new teachers undertook 
on-the-job training at Lexington. All students were pre-tested. According to the local 
press, Dr. Vruggink felt that the same educational results could be obtained with- 
out the expensive guarantee of the performance contracts at Franklin and Lexing- 
ton; the $60,000 cost of th^ two new Learning Centers was characterized as a saving 
of about 60 percent. 

The Grand Rapids Press, Monday, December 21, 1970. 



SUMMARY OF THE WLC PROGRAM 

WLC’s Learning Centers featured contingency management and individualized 
instruction remotely prescribed from Albuquerque, New Mexico. The program was 
moderately hardware-oriented, and primarily utilized commercially available 
equipment and materials. 

There were two learning centers, both in inner-city schools. Initially, the cen- 
ters accommodated the lower achievers of grades one through six. At midyear, the 
program was revised to include all but the special-education children. The contract 
set a fee of $149.50 for each student in the program; the maximum, total fee was set 
at $144,000. 

Average gains as measured by Metropolitan Achievement Tests were 0.67 in 
reading and 0.68 in math. In reading, about half the students satisfied the one- 
achievement-year minimum gain required for payment; in math, about one-third of 
the students satisfied this rsquirement. 

After school started, GRS contracted with WLC for learning centers in two 
other schools but dispensed with performance guarantees. These learning centers 
became operable in January, with WLC providing materials, pre-service training, 
and supervision. 

In June, WLC iiistruction management activities were assumed by Learning 
Unlimited, a new firm headed by a former WLC official. GPS contracted with Learn- 
ing Unlimited, at,ain with no performance guarantees, to continue the four learning 
centers in 1971-72 and to introduce a new learning center in a fifth school. 
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IV. THE COMBINED MOTIVATION EDUCATION SYSTEM 
CONTRACT LEARNING PROGRAM 



PROFILE OF SOUTH MIDDLE SCHOOL 

South Middle School is in Grand Rapids’ Model Neighborhood (see Fig. 6). It 
receives funds from ESEA Title I and from Michigan’s Section 3 funds earmarked 
for disadvantaged children. South Middle’s 1100 students are black, come from 
low-income families, and are a transient population, as evidenced by a 21-percent 
turnover rate. The school has had its share of student tensions: it was closed for 
three days in 1969-70 fbllowing a stabbing incident. Absentee rates vary around 15 
and 20 percent; Fig. 7 is a plot of attendance for each of the four grades on fourth 
Fridays. Se\^enty-five percent of the students are below national norms. The median 
grade gain per year has been about 0.4, The table below presents average grade 
equivalents from the September pre-testing with the Educational Development Se- 
ries published by Scholastic Testing Service. 

There is little parent involvement in the school. To illustrate, only 18 attended 
the CMES parent meeting on September 8. One of the parents, who works in the 
Model Neighborhood office, said that this is typical at South Middle and that parents 
are probably not aware of the breadth of the program. She said that Grand Rapids 
PTAs are practically nonexistent, p artly because of busing. Busing tends to separate 
siblings and thus spread each set of parents over more schools and more area. 
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SCHOOL ATTINDANCE AREA 
BOUNDARIES Ai OF SffT, l9Si 

MODIL NEIGHBORHOOD 
ATTENDANCE AREA 
SOUTH MIDDLI SCHOOL 



Fig. 6— CMES Program: South Middle School and Model Neighborhood Area 
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Fig. 7— Attendance at South Middle School, 1969-70 
(fourth Fridays) 





Nwfbev of 


NonveAat 


Reading 


Math 


Total 

Abitit. 


'ade 


Students 


Saope 


Score 


Soore 


Soore 


6 


303 


5.2 


4.2 


4.3 


4.7 


7 


231 


6.1 


5.2 


5.2 


5.5 


3 


220 


7.2 


6.3 


6.3 


6,7 


9 


2.33 


8.2 


7.3 


7.3 


7.5 


Total 


1027 











THE CMES FORMAT 

CMES provides seminars and training pi ggiams in which participants learn 
how to motivate themselves to achievement. Their clients include buBinessmen 
school administrators, and retiring military officers. During 1970-71, CMES had two 
performance contracts— one in Greenville, South Carolina, and one in Grand Rap- 
ids. Its educational program is hardware-oriented. The Borg-Warner System-80 ma- 
chine is used with B-W programs in reading and math. Hoffman Readers, cassettes, 
and workbooks from Educational Progress Corporation, and math tapes from Elec- 
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tronic Futures, Charles Merrill, and Imperial are also used. There are other materi- 
als ft’om a variety of pubhahers (see Appendix F). 

All students entering the program receive thorough diagnostic testing to deter- 
mine a proper instructional level. Once a student’s level is determined, he is again 
tested to discover the areas within this level needing more concentrated and special- 
ized work. 

After all diagnosing has been completed and prescriptions have been v/ritten, 
students work independently at their own work stations on individualized material. 

Each student is also allowed to advance as rapidly as his abiiity permits. A 
teacher or aide, however, administers a post-test to each student at the end of a 
series of exercises to determine if he has sufflcientiy mastered the skills prescribed 
in those exercises. 

Students spend one hour per day per subject in the program (all are not neces- 
sarily registered for both reading and math). The academic curricula have a pri- 
mary, redundant, and supplemental system so that if a child cannot learn a skill 
through one system, the teacher can try another. One out of every five hours is spent 
in AMS (achievement motivation sessions). These sessions are like highly structured 
eiiwounter groups; the intent is to get students to identify past successes, analyze 
why they perceive the events as successes, then set short-term objectives that in- 
crease the probability of success. 

After a student has successfully completed an educational task, he is allowed 
to choose a reinforcing event; this event may vary, but includes such activities as 
playing games, listening to popular music, reading books, viewing filmstrips, or 
simply relaxing. As a student becomes more competent, the amount of work is 
increased and the amount or type of reinforcement is changed and eventually 
phased down to a miniiiium, 

The performance contract is written in terms of academic performance, while 
the achievement motivation experiences are designed to personalize and humanize 
the learning experience. 

After two or three yearb of successful demonstrations, the company intends to 
turn over the entire instructional system to the school district. 



CME8 AT SOUTH MIDDLE SCHOOL 

II 

The on-site manager for CMES was Mr. Claybeon Coleman; he had been princi- 
pal a . o,, dddle during 1969-70, but was on leave of absence from Grand Rapids 



Schools during 1970-71 to participate in the CMES program. To insure that Coleman 
would retain his fringe benefits and tenure status with GRS, it was arranged that 
his paycheck would come from GRS. At their meeting on September 8, however, the 
school board refused to confirm his appointment since the CMES contract was not 
yet signed and there was a question of proper and legal sequence. Coleman remained 
in acting status for a while, as did the CMES program teaching aides. The board did 
agree to confirm Elia Lumpkin’s appointment as principal of South Middle. Acting- 
Superintendent Muth was very adamant on the latter action; with Coleman’s status 
uncertain, he felt it necessai’y that there be no question among teachers as to who 
the South Middle principal was. 

The program teachers were chosen by CMES and district officials on the basis 
of interviews with South Middle School teachers. 

The first weeks of the CMES program were marked with some confusion be- 
cause students were switched among classrooms and some materials had not ar- 
rived. Students were discontented; many ninth-graders, who traditionally have the 
privilege of arranging their own class schedules, tried to get out. They did not like 
to be experimented on, they disliked being identified with a program that also 
included "special education” youngsters, and they disliked the initial confusion. 

CMES was very unhappy not to be able to move into their classrooms on time. 
Start-up costs and classroom renovation according to CMES specifications were the 
responsibility of the school board. CMES felt it was the board’s responsibility to put 
the crews on overtime if necessary. At the time, Mr. Charles Welch, who supervised 
CMES’ performance contracts, was of the opinion that there would have to be 
deductions from the contracted results because of the late start. He was also un- 
happy over the large amount of testing that was going on (pre-testing, re-testing, 
diagnostic testing, testing related to the OEO experiment, and the district testing 
that would begin in January); he worried that "over-testing” would affect the stu- 
dents’ attitudes. 

There were to have been 600 pupils in the program but only 463 had enrolled 
in school by September 8. Because the school would have been hard-pressed to meet 
the guaranteed student participation, the program was reduced from 1200 to 1000 
instructional units—about 540 students (an instructional unit represents one stu- 
dent enrolled in either reading or math). 

CMES had rejected nine students for behavioral reasons by mid-November, and 
11 more were rejected by June. CMES wanted to reject about 16 more, but Mrs. Mary 
Edmond, the assistant principal who was monitoring the program to protect the 
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district’s interest, talked CMES into keeping them. She regarded the initial confu- 
sion as an inappropriate context in which to decide whether a student should be 
rejected; she also feels that CMES did not try hard enough to handle its student 
problems in-house (CMES was supposed to handle its own discipline). 

Mrs. Edmond predicted in December that 100 or more students would exceed 
the 10-day absence limit set by the contract; by April, the limit had been extended 
to 25 days. 

As of January, 649 students were enrolled in the program, distributed among 
the grades as follows: 





Regular Students 


Speaiat 




Grade 


neading 


Math 


Total 


Eduoation 


To'ta 


6 


176 


173 


178 


20 


198 


7 


115 


114 


116 


11 


127 


8 


118 


119 


120 


7 


127 


9 


32 


79 


85 


12 


97 


Total 


441 


485 


499 


50 


549 



Irivolvement of Model Cities 

The Model Cities Education Committee^* conceived of a smaller demonstration 
program for South Middle School in January, 1969 with the objective of demonstrat- 
ing the possibility of dramatic educational progress. GRS developed the performance 
contracting idea for South Middle, which coincidentally suited v»^hat Model Cities 
had in mind. Model Cities agreed to contribute 26 percent of the total budget of the 
CMES project. As evidence of their support, two board members and one staff 
member went to Texarkana to observe that pioneer performance contract. They 
conferred with Thomas of CMES, and in other ways participated in initial planning. 

Model Cities has bsen a fixture in Grand Rap/ds for over two years and has an equal partnership 
with the city on public programs serving the Model ileighborhood. The buundaries of the neighborhood 
are indicated in Fig. 6. The city applied fbr the initial Model Cities grant, specified what would coniprise 
the model neighborhood, and held a public meeting to solicit the participation of citizens living in that 
neighborhood to serve on the board in the winter of 1968-69. There is a downtown office called the CDA 
(City Denionstration Agency) that works under the direction of the city manager. The neighborhood office 
Is on Division Avenue near South Middle School. Funding comes through the HUD office in Chicago. 
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Model Cities officials stated their commitment to maintain ”the community’s repre- 
sentation” in the project. Their funding did not come through until midspring; their 
contract v/ith the school district appears in Appendix G. 



Contract Provisions 

The maximum contractor payment was set at $164,000, and start-up costs wei e 
an additional $90,000. Model Cities promised $60,000 ($40,000 for start-up and 
fjalaries, up to $20,000 tied to performance). Section 3 provided $90,000, and $100,000 
was allocated from Title I. 

The contract called for a paymen t to CMES of $60 per achievement year (see 
Appendix G); achievement was to be measured by pre- and post-testing \ 'ith the 
elementary level of the Educational Development Series published by the Rciiolastic 
Testing Service.*® The district paid for the materials, equipment, and remodeling; 
CMES generally prefers to supply materials and equipment, but the district had 
about $100,000 in uncommitted funds that they wished to allocate before the end 
of the year. 

All students who were two grade levels below national norms were selected to 
participate; others were added to fill out the group. There were 186 school days in 
the 1970-7^ Grand Rapids school year. The CMES contract called for 180 days of 
instruction, but was not explicit in spelling out what would happen if a minimum 
of 180 days’ instruction could not be provided, nor by what date pupils had to be 
tested. Unfortunately, rooms assigned CMES were not finished until mid-Septem- 
ber; in addition, enrollment in the school did not stabilize until around the 17th or 
18th, so it was not known who was in the program, nor could replacements be 
selected. It was unlikely, therefore, that 180 days could have been available even if 
there had been none of the usual school-year disruptions. CMES eventually disre- 
garded this requirement. 

Dr. Walter Thomas, director of education programs for CMES, has described 
how he arrived at the contract fee. Thomas projected the first-year costs for 600 
students or 1200 units of reading and math, to be $166 per learning unit for costs 
not explicitly borne by the district (e.g., start-up costs). CMES figured on an average 
achievment gain of 2.0 years, but underpriced themselves at $60 per achievement 

The contract specifles that growth will be measured by "Grade Score Increase.” Some of the 
statistical aspects of this concept are discussed in Appendix E. 
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year (i.e., $120 per student on the average), counting on lower costs in the second 
and third years. 

At the year’s end, CMES expected ordy 1.3 years’ average gain. They were also 
penalized by a shorter school year (less than 180 days). Because of absenteeism and 
testing difficulties, payment was made on the basis of about 30 percent of the 
.rticipants. CMES also risks having to buy the equipment at two-thirds of cost after 
one year or at one-third of cost after two years if the program fails. Thomas has not 
been fiatisfied with normed achievement tests as basis of payment. Accordingly, 
CMES’ future contracts will utilize mastery testing. 

Testing 

Dr. Anne Kennard, of the Elk Grove, Illinois school district, was retained by 
CMES to evaluate a number of tests, using criteria specified by CMES. She recom- 
mended that the Educational Development Series published by the Scholastic Test- 
ing Service (STS) of Chicago be used for the contract-apecifled pre- and post-testing. 
CMES provided interim testing every six weeks with the Burnett Reading Series, 
also published by STS. It had been intended that the first week would be spent in 
diagnostic teats, but that had been impossible since the learning centers were not 
yet physically operable. 

The Educational Development Series pre-testing was administered on the 
mornings of September 10 and 11, using the test level usually specified for grades 
4 to 6; besides reading and math, the tested areas were (1) solving everyday prob- 
lems, (2) verbal reasoning, (3) nonverbal reasoning, and (4) future plans. This test 
was centrally administered over the public address system by the head counselor in 
two 2-hour sessions, with homeroom teachers monitoring. The motivation of this 
procedure was to allow a trained person to administer the test without pulling 
students out of the familiar homeroom Betting. 

Examiner’s manuals for the EDS did not arrive until the night before the 
testing began, so the teachers did not have much time to study them. Nevertheless, 
the testing proceeded smoothly according to plan. The us© of the intercom system 
for the timed portion of the test seemed to work well. On the surface, all was orderly. 

Three months later, however, Mrs. Edmond raised questions regarding the pre- 
test results, since she felt the students were being overtested. During the first few 
weeks, the students received the EDS, the Battelle-adminiotered test, the CMES 
diagnostic tests, and the retesting of students who had obviously played games with 
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their EDS answer sheet. In December, there was the testing of students who scored 
below "chance” level on the EDS, and the next month saw the start of the regular 
district testing program. 

Students whose scores on the pre*test were below chance level (as spelled out 
in the test manual) were retested with the lower primary level EDS test, STS was 
not aware of this retesting, and objected when it found out; the norming group for 
the primary level test had nowhere near the maturity of the CMES youngsters, and 
the STS tests are roughly geared to curriculum content anyway. As of February, 
Vruggink had agreed that the 200 or so chance scores therefore would be excluded 
from the contractor payment formula, and that the fee for their participation in the 
program would be equal to the average for all other participants. 

Participants were administered post-tests (reading and math sections only) dur- 
ing the last week of May. The complete battery was to be given to a subset of 60 
participants. Fifty or 60 participants missed the post-test, even though five days 
were allowed for this purpose; apparently this should be regarded as characteristic 
of this student population. 

The district evaluation of the CMES program consisted primarily of comparing 
the EDS pre-test with the EDS post-test, and making a subjective assessment of the 
overall experience. GRS hired Professor Edsel Erickson from Western Michigan 
University at Kalamazoo to be the contract-specified independent evaluator. He also 
was to evaluate the affective aspects of the program. Mrs. Edmond designed an 
attitude-measuring instrument on her own that was administered two or three 
times to 50 students in the program and 60 students out uf the program; presumably, 
these data were used in the district’s evaluation. It was CMES’ responsibility to 
negotiate a contract with STS, a contract that also includes some evaluation; Erick- 
son’s independent audit of test scores was to keep everything aboveboard, but STS 
nevertheless studiously eschewed contact with CMES to avoid allegations of collu- 
sion. Finally, Mrs. Charles Bearden, Model Cities Evaluation Coordinator, was con- 
ducting an evaluation of his own. 



Gains in Reading and Math 

CMES and the district began negotiating contract payment on August 6. CMES 
was anticipating the average achievement gain per instructional unit to be on the 
order of 1.3, but some disagreement was anticipated because of absenteeism and 
testing difliculties. With CMES’ agreement, the district decided to determine the 



average achievement gain simply from the performance of those students v/ho 
attended at least 160 days and who had taken both the pre-test and the post-test. 
Under this procedure, 165 students registered an average gain of 1.0 in math, and 
140 students registered an average gain of 1.2 in reading. For purposes of payment, 
these gains were then attributed to the 1000 instructional units (500 in math and 
600 in reading) that the district had guaranteed CMES. In other words, the district 
paid for 500 math achievement-years and 600 reading achievement-years on the 
basis of the gain of about 150 students. 

Although the contract stipulated that gains would be calculated using the STS 
Grade Score scale, the district chose to use grade equivalents because gains thus 
calculated were lower; CMES agreed. The difference between the two scoring scales 
is discussed in Appendix E, 

Summary of Resources and Program Characteristics 

Table 8 provides summary descriptive information for the CMES reading and 
math programs at South Middle School, Corresponding information for the regular 
program is provided where applicable. 



YEAR-END COMMENTS FROM STAFF AND PARENTS 

Opinions of Mrs, Edmond, CMES teachers, non-CMES teachers, and parents are 
summarized in the following paragraphs. 

V ice-Principal 

In the opinion of Mary Edmond, the CMES program is not a panacea, but it 
would be difficult to design another program that would be more effective; this year's 
performance was promising, and, in the absence of the operational problems that 
have already been described, the program could excel. She recommends that a 
well-documented attitude test be administered at the beginning and end of the 
program to assess progress toward non cognitive goals. She feels that low parBnt 
awareness dampens the impact of the program. 
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Table 8 



SUmmY OF RESOURCES AND PROGRAM CHARACTERISTICS FOR 
COmiNED MOTIVATION AND EDUCATIONAL SYSTEMS, INC, 

South Middle School 



Ch^aotg^istiGB of s^d&nbs 



ProgTasn aaope 

No, of studenta (tfiid=December) ® , 

C la 3 a t inia 

Class 

Number of sections* i 



Grades 6‘“9; transiency 26%; blacky Mdel=- 
cities neigUborhood ; low income; lowest 
achievers according to last spring -s testing; 
special education pupils included; program 
pupils distributed mdong all homerooms 

491 i reading ; 535 , math 

45 minutes per day each, reading and math 
35^40 in Single Center (SC) (40 optimum); 
60-65 in Double Center (DC) (optimum) 

14 each (T-period day) 



Paailitie-B 

Space , * • 

t 






Students/classroom/ day^ •*,**•,*, 
Furnishings t***. 



Staffing 

Certified teachers^ 

Special teacheri 

Paraprof esslonals « 

Other personnel * * « 



4 centers I 1 DC for reading and math; 1 SC 
for reading and 1 SC for math; each center 
has an Instructional and an AMS area; 1 rein- 
forcement room; total occupies space of 7 
former classrooms (walls were changed) 

Number of enrollments/numbar of classrooms ^ 
(491 + 535) /7 ^ 147 

Table space for carrels; carpeting; air 
conditioning; 1 carrel per student per 
class (approximately 140 total) ; chairs 

1 per center (i*e#i 1 per SC, 2 per DC) 

0 

Full time; 1 per center, 1 for reinforcement 
room, 1 substitute 

1 full-time director,^ 1 full-time secretary^ 



Equipment 

Primary unit ., * * *,**••*,*...«.* » 
Supplementary system* .**•**••.*, 



Redundant system* ■****••***•»*■* 



Reading I 40 Hoffman reading mar^hln^s; 
math i 40 tape recorders/ center (80 total) 
Reading; 25 tape recorders/ center (50 
total) I ^ math I 40 flashcard readers 
(Electronic Futures) 

15 Borg-Warner System 80 for reading and math 



Materials^ (10% consumable) 

Reading •**•*•**■•**•*#***,>* **** 

Math #««*ag******C9*************» 

Reading and n^th ••t****,*,,,**** 



^e^&ervioB training* *••*,*.«,***• 



2 sets EPL tapes per center; 2 sets Hoffman 
materials (levels B to G) per center; workbooks 
Math mlnl-"system (topes); workbooks 
2 sets Berg-Warner materials (levels 1-8) per 
reading and math center (l*e*, 4 complete sets) 
1 notebook per student for compiling materials 

1 week on AMS in-depth training, 1 week gains 
through materials 



In^seppioB training About 2 hours a week 



Other support * . . * Nonei 

Inaentivee None 

For footnote*, see following page, ^j4 



iftstructlonal pragram self-contained 



Table B-^Qontinu&d 



®The total number of students receiving Instruction in reading and/or math 
was 549. 

^Tha areal unit here is the space occupied by one of the original class- 
rooms ^ regardless of how walls were rearranged to accommodate the CHES 
centers . 

®Tha utilization of certified teachers wag more intense for CMES than 
under the regular program. Regular teachers taught six periods a day* and 
received extra pay for tasks performed at other times, including hall duty 
during their preparation period, QffiS teachers generally gave up their 
preparation periods tu stay in the centers; because of union pressure, 
they were not eligible for extra compensation, MES teachers felt that if 
they had a comion preparation period instead of the staggered arrangement , 
the problem would be solved. The assistant principal felt that preparation 
for cms instruction is a more critical need than for the regular program 
since the former requires IndlvidualiEed instruction. 

**Not all of the director's duties will prabably be Incremental to the 
regular principal's staff when the program is turnkeyed, since the director 
was not entirely autonomous in running the program, and probably had some 
tasks that were redundant to normal administrative duties; also, his role 
will presumably relax somewhat whan the program has become established. 
Another factor is that a significant portion of one vice-principal’s time 
was consuined in monitoring the operation. Thus, it is not unreason- 

able to presume that the turnkeyad program would Impose little additional 
burden on the normal eomplOTent of administrative staffing, 

^ot all of the secretary's duties will probably be Incremental when 
the program is tumkeyed. 

“The cassette tape recorders are manufactured by Iowa and Sharp; their 
maintenance is a troublesome ptoblra since they are not constructed to 
sustain the constant heavy use they receive in the centers. The program 
director feels that the movm eKpensive Wollensak recorders would be cheaper 
in the long run. 

®It is not clear what coraaon denominator (if any) should be used for 
comparing constraable materials resu rces. Except for notebooks in which 
to compile fjorkbook pages, etc., CMS hai. no instructional materials that 
are coniumed strictly on a par^student basis; the other consimables are 
treated as resource ^teriais, to be cut up and distributed as needed. The 
logical unit wou3.d be materials per student per aehievment level, but such 
detail is probably not warranted since only 10 percent of the materials are 
consimable • 



CMES Teachers 



Two CMES teachers were interviewed, one from reading and one from math. 
The following paragraphs summarize their comments. 

The two-week training period was necess0j*y to learn to use the equipment and 
materials, and to run the AMS. The training was not as good as it could have been, 
so there will be some changes for next year (the training time will not be increased). 
There will also be changes in the AMS material to make it more relevant to South 
Middle School, as well as some changes in instructional materials. CMES also hopes 
to train some substitute teachers (there were no trained substitutes last year), and 
to hire a new teacher. 

Reading instruction for the CMES progran\ takes much more time than regular 
teaching, which apparently was something of a surprise to the company. Scheduling 
problems must be resolved to allow teacher breaks when there are no students in 
the classroom; breaks are apparently effective only when teachers are completely 
free of their supervisory roles. 

It took the CMES teachers until around January to build up momentum. There 
was initial disappointment over the Board of Education’s seeming lack of interest 
in getting materials to the school on time, the lateness of the contract, and other 
complications. Teachers look for great improvements next year. They are, in fact, 
submitting proposals for change to CMES. 

The CMES staff felt professionally isolated from the regular staff, partly be- 
cause there was not enough time to attend regular staff meetings as well as their 
own. 

All the materials in the program were used; none should be deleted; however, 
students seemed to respond particularly wall to the SRA "We Are Blacks" material. 
There was a need for more variety in the Reinforcing Event materials, however, as 
well as more room for that activity. Some students would become bored with RE and 
elect to remain in the instructional area to look at filmstrips. 

While the program provides individualized instruction, it requires a certain 
motivation toward self-reliance from the students. Therefore, students who simply 
do not want to be in the program should be released and returned to tha regular 
program or receive special individual attention. 

Part of South Middle SchooTs apparent improvement in attitudes may have 
resulted from CMES, but much should also be attributed to the discipline imposed 
by this year’s new teachers in the regular program. There was a marked positive 
change in students’ attitude toward testing this year, 



In a typical CMES week, each student in reading had three sessions of instruc- 
tion, one in AMS, and one in RE (if his progress in the instructional area was 
satisfactory). The teacher and the center manager took turns running the AMS. The 
teacher periodicaliy checked with the aides on the progress of instruction. Students’ 
programs were developed by the teacher; the responsibility of the aides was to make 
sure students progi essed toward their goals, and to help if necessary. Aides did not 
teach. Students always had supervision, but not necessarily the presence of a 
teacher. 

One of the most useful features of the CMES program was that teachers were 
encouraged to communicate directly with Thomas of CMES via their "hotline to 
Chicago." Response was prompt. 

Regular Teachers 

Two teachers from the regular program were interviewed, one from science and 
one from social studies. A third teacher was contacted but did not care to comment, 
possibly because of Superintendent Runkle’s request to tbe staff that the contract 
learning programs not be discussed until after payment was settled. 

These teachers observed the CMES program several times, and had no com- 
plaints. CMES did not try to set itself apart from the regular program; the on-site 
manager had been receptive to inquiries about the programs of particular students. 

CMES physical accoutremonts would be invaluable in the regular classroom as 
a means to provide a nondistractive atmosphere. Individualized instruction would 
be valuable in the science curriculum, but would require more manpower. 

CMES students seem to display a noticeable change in their attitudes toward 
school. There is a definite need for this kind of remedial program, but it will take 
another year to determine whether CMES is the solution. 

Parents 

Working from the South Middle School Master Card Listing (which provides 
parents’ names and addresses) and the January student roster for CMES, we se- 
lected 64 parents fbr interview. Of these, 37 had no telephones listed at the given 
addresses, and 7 of the remaining 17 were not at home. We contacted 10 parents, 

5 of whom had ninth-graders in CMES, 4 had eighth-graders, 4 had seventh-graders, 
and 3 had sixth-graders. Of the 10 parents contacted, only 6 had heard of CMES, only 







4 knew they had children in the program, only 2 knew which of their children were 
in the program, and only 3 were informed enough to comment on the program. The 
results suggest that (1) there is low parent awareness of the program, or (2) there 
is a reluctance on the part of parents and/ or students to reveal association with the 
program, or (3) the January student roster was inaccurate. The following are ex- 
cerpts from the parents’ comments. 

Mrs. A—participants in 7, 8, and 9. She said her seventh- and eighth-graders 
were in the program, but the ninth-grader was not. She thinks CMES is "really 
nice,” and that her children really enjoy the program. The eighth-grader thinks "it 
teaches better”; he thinks the program should be continued, but cannot say how it 
might be improved. 

Mrs, B — participants in grades 6 and 9. She knew that "one” of her children was 
in CMES, but she had to ask to find out which one it was. After the interviewer gave 
her a brief explanation of the program, she commented that children learn better 
from teachers than from tape recorders. "They don’t try to learn when it’s already 
there on the tape.” 

Mrs. C—her sixth-grader was originally a participant They moved in midyear 
out of the South Middle attendance area. She did not know whether her children 
were in the program before the move and did not know anyone who was. 

Mrs. D— participant in grade 6. She knew nothing about the program. She had 
to ask her children whether they v in it, and two said yes. She had the inter- 
viewer talk to her son. He told the i -erviewer that he and the other children liked 
it. He could not think of anything he disliked, (This boy was not on the CMES roster.) 

Mrs. E— participan ts in 7, 8, and 9. The mother was not at home for the first 
call, so the interviewer talked with her eighth-grade daughter. She said that "CMES 
taught me more than the other classes.” She also said th.it all the children liked it; 
she could not think of anything that should be changed. 

On the second call, the mother was home and was very positive toward CMES. 
She liked it, the children liked it, the children learned faster. She could not think 
of anything that should be changed. She does not know any other parents with 
children in the program. She went to the open house and the program was explained 
to her satisfaction. "A lot of parents were there.” 

Mr. F-— participant in grade 9. He said he had no children in the CMES. He did 
not know anything about the program. 

Mr. Q— participants in grades 7 and 9, nonparticipants in grade 6. He had never 
heard of CMES. None of his children were in the program as far as he knew. 




Mrs. H— participants in grades 6 and 8, nonparticipant in grade 9. She said she 
had no children in the program, and knew Jiothing about it. Then she said she had 
heard favorable talk among the teachers (she works at the school), and that Mr. 
Lumpkin had shown her the rooms. Three times, she said she would like her sixth- 
grade daughter (who is in fact on the CMES list) to be in the program. The inter- 
viewer talked with the eighth-grade daughter (who is als j on the list), and she said 
she was not in the program. 

Mrs. T— granddaughter is a participant, grade 8. She knew her granddaughter 
was "in some kind of class," but knew nothing pbout the program except that her 
granddaughter liked it. 

Mrs. J— participant in grade 7, nonparticipant in grade 9. She had to ask her 
children if they were in the program. On? girl said she was, and that she liked the 
program. The mother knew nothing about it. 



SUMMARY OF CMES PROGRAM 

The CMES program involved contingency management and individualized in- 
struction. The program was unique in that specific classroom time was designated 
for the development of achievement motivation. The program was highly hardware- 
oriented, and utilized commercially available equipment and materials. 

The program accommodated the 550 lower achievers in an inner-city middle 
school, grades 6 through 9 (including special-education children). The contract set 
a fee of $60 for each achievement year gained by each student in reading or math; 
the maximum total fee was set at $164,000. 

Average gains for those students with pre- and post-test scores who attended at 
least 150 days were 1.2 in reading and 1.0 in math. For purposes of payment, these 
gains were attributed to the 1000 instructional unite (600 in reading and 600 in 
math) that the contract guaranteed to CMES. 

GRS and CMES contracted to continue the program during the 1971-72 school 
year, with payment based on interim mastery testing as well as gains on achieve- 
ment teste. 
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V. THE ALPHA CONTRACT LEARNING PROGRAM 



Alpha’s program provided reading and math instruction in three inner-city 
schools: West Middle, Alexander, and Hall (see Fig. 8). Alpha’s programs were part 
of the OEO’s experiment in performance contracting involving .20 programs in 20 
cities, 6 commercial contractors, and 2 teacher groups. Alpha also had programs 
under the OEO experiment in Hartford, Connecticut and Taft, Texas. OEO’s RFP 
(Request for Proposal) and the resulting contract between GRS and Alpha are 
reproduced in Appendix H. 



PROFILES OF WEST MIDDLE, ALEXANDER. AND 
HALL SCHOOLS 

West Middle School accommodates about 1500 students in grades 7, 8, and 9. It 
receives funds from Title I and Michigan’s Section 3. The racially mixed student 
body comes from low-to-medium-income families. Yearly turnover is about 14 per- 
cent. The absentee rates (on fourth Fridays) range between 14 and 18 percent. 

Alexander and Hall schools have student populations of about 600 and 400, 
respectively, covering the first six years plus kindergarten. Both receive funds from 
Title I and Section 3, and both serve attendance areas inhabited primarily by low- 
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inconi^. families. Alexander is mostly black; Hall is largely black and Spanish- 
Arrierican. Both have turnover rates of about 22 percent, and fourth-Friday absentee 
rates range from 5 to 16 percent. Achievement, as measured by ihe Stanford 
Achievement Test, is generally lower than district-wide averages; some average 



grade-equivalent scores from the April 
below: 



Grade 4 





Reading 


Math 


Alexander 


2.9 


3.3 


Hall 


3.6 


3.9 


District 


3.9 


4.1 



1971 testing of grades 4, 5, and 6 appear 



Grade 


5 


Grade 


6 


Reading 


Math 


Reading 


Math 


3.9 


4.2 


4.2 


4.4 


4.2 


4,6 


5.0 


5.0 


4.9 


5.0 


5.5 


5.8 



THE ALPHA FORMAT 

Alpha is a spin-off from WLC. The premise of its program is that "regular 
teachers, given the training and tools of educational technology, can do as well as 
an outaide, hardware-oriented educational contractor,” It characterizes its role as 
one of giving a team of regular teachers thr training, tools, and daily logistic support 
needed to help them conduct individualizeci, learner-centered classrooms. 

The two bases of this program are (1) h savy reliance on commercially available 
programmed texts assigned to each individual on the basis of his own achievement 
level (to provide success experiences), and (2) contingency contracting with the 
students. Good behavior is rewarded, but there is minimum reaction to bad behavior. 

I*resumably, a student in an Alpha classroom works individually, at his own 
pace. He begins each day with a teacher-made learning prescription based on his 
demonstrated competence and need. He studies in brief, intensive units of time at 
the end of which his comprehension is immediately tested. If he does not measure 
up to expected performance or if he still needs work, the teacher gives individual 
aid then and there; when hte performance is high, he is immediately rewarded. 
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ALPHA AT WEST MIDDLE, ALEXANDER, AND HALL 



In Grand Rapids, the program used regular classrooms without modification 
except for the "free room,” which was equipped with games and pinball machines. 
The program established a token economy, wherein the students received paper 
scrip or tokens for fulfilling their respective contracts. The scrip could be cashed in 
for smaUer material goods, exchanged for time in the free room, or banked to pay 
expenses on program-sponaored field trips. Each participant at West Middle spent 
about one-third of the school day in the program. Alexander and Hall participants 
attended for half a day. 

The intent was to put together an approach that could easily be worked into an 
existing school with the existing stair accordingly, Alpha did not press to select the 
teachers, and it ignored environment improvement. The Alpha staff were very 
optimistic about their program, and were quick to cite evidence of improved student 
attitude. As of November, they had rejected only one of the 600 students in the 
three-school program. They also pointed out that they would ultimately prefer to 
restrict their role to teacher training and workshops. 

The 600 participants were distributed among the grades as follovys: 



Sahoot 

West Middle 

Alexander 

Hall 



1 2 3 7 8 9 Total 

100 100 100 300 

50 50 50 150 

43 64 43 ISO 



The program at each school occupied three classrooms, one serving as the free 
room. At West Middle there were three teachers and five aides; two of the aides ran 
the free room. Two teachers and three aides were in each of the programs at 
Alexander and Hall; each free room had one aide. 

There were two weeks of pre-service for teachers, covering such areas as cur- 
riculum, behavior modification, contingency management, and procedures for diag- 
nosis and prescription. The staff attended their own in-service programs rather than 
those of the district. This amounted to about four days per year. 



Selection of Participants and Formal Evaluation 

Biotechnology, Inc., under contract to OEO, was responsible for selecting the 
three schools and the participating students. The Grand Rapids School Board sub- 
mitted lists of students in the Title I schools, with achievement test scores. These 
had been ranked, and Biotechnology picked the schools with the greatest deficiencies 
for the treatment program. The most defic i of the remaining schools became the 

control group. Students in the treatment ana control schools were then ranked 
according to an average of math and reading achievement scores, and essentially 
those at the botlom of the lists were chosen. 

OEO designated Battelle Memorial Institute as overall evaluator for their per- 
formance contracting experiment. According to Battelle’s contract, it is obliged to 
provide participating school districts only with (1) the scores on the pre-test and 
post-test, (2) the gains between the two tests, and (3) .scores on the interim perform- 
ance testing. Battelle is also supposed to administer (1) an initial questionnaire to 
all parents covering socioeconomic status (SES) and attitudinal information, (2) an 
ending questionnaire to parents on attitudes, and (3) questionnaires to 50 ninth- 
graders at each experimental, control, and comparison group covering attitudes, 
perceptions, and general feelings; there is no mention of feeding back any of these 
data to the districts. On the other hand, Mrs. Joan Webster, who was the OEO- 
funded director in Grand Rapids, was an employee of the district and had the 
advantage of full-time attention to the Alpha program; she and her staff performed 
extensive evaluation activities. 

In Grand Rapids, certified substitute teachers administered the pre-test under 
Battelle’s supervision. The original plan was to test 600 Alpha paiticipants, 300 
comparison ^ "up students (nonparticipating students in the treatment schools), 600 
of the control group (25 students per grade level per school), and 226 in each of the 
two special treatment groups (remedial reading at the various reading centers and 
Project READ at Madison School). To provide the district with comparable data on 
Alpha, WLC, and CMES, it was later decided not to test the first-grade remedial 
reading pupils, but to test as many as possible in grades 1-3 in the WLC program 
(160) and to test a large fraction (400) of the CMES students in grades 7-9. The testing 
was done in groups varying from about 36 to 300 (the experimental group at West 
Middle School). Experimental school teachers and others connected with Alpha 
were banned from the classrooms during testing. 




Summary of Resources and Program Characteristics 

Table 9 provides a rough summary of resources that are directly identifiable to 
the Alpha program. 



FOLLOW-ON CONTRACTS 

GFvS and Alpha have contracted to enlarge the program at West Middle Schocil; 
payment will be mostly on performance, but a flat rate will be charged for younjj- 
sters who have a history of poor attendance. The programs at Hall and Alexander 
schools were also continued, at a flat rate, with all regular teachers having optioris 
to take advantage of the facilities. Alpha was the successful respondent to the 
Request for Proposal issued for a program for the Educationally Handicapped at 
Coldbrook Sciiool during the 1971-72 school year. Alpha was also hired to provide 
management support for jnstruction at Fountain and Kensington schools, and to set 
up a workshop on behavior modification for reading teachers during the summer of 
1971. 
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VI. CONCLUSIONS AND IMPLICATIONS 



At the end of the year, the GRS opinion of its performance contracts was mixed, 
though predominantly favorable. It appears that the technolog;'/ and organization 
packaged by each contractor constitute effective learning systemis, but the perform-^ 
ance payment machinery is generally regarded as bothersome. 

Most people involved with the programs have been favorably impressed, but 
look for more visible improvement in the second year of operation. These sentiments 
were borne out by the interim report to the Board of Education (Appendix A), by the 
recommendations of the Contract Programs Committee (Appendix B), and by per- 
sonal conversations with many people around the district. 

The CMES and WLC programs "worked” in the sense that conventional meas- 
ures of achievement indicated somewhat better performance than would be ex- 
pected from regular instruction; although test data were not available for Alpha, the 
opinions of persons close to the program indicated similar performance. Moreover, 
all three successfully offered approaches to systemizing instruction, provided in- 
dividualized instruction, and set pupil motivation as an important objective (al- 
though some might argue that the motivation was for irrelevant rewards). 

Grand Rapids has elected to hold final judgment in abeyance for a year, but the 
fact that these programs will be expanded is testimony to its optimism. 

CMES will continue at South Middle School, with payment to be based on 
interim mastery testing as well as gains on achievement tests. Minimum and max- 
imum bounds will be placed on payment. 



WLC has phased out its instruction management activities, but their letirning 
centers will continue at Franklin and Lexington schools on a flat-rate per-student 
basis under the management of'Learning Unlimited (a new firm headed by a former 
WLC official). There will also be learning centers at Sibley, Straight, and Coit 
schools, all at flat rates. 

Alpha will be expanding its operation at West Middle School; payment will be 
mostly on performance, but a flat rate will be charged for youngsters who have a 
history ^ f poor attendance. The programs at Hall and Alexander schools vdll con- 
tinue, at a flat rate, with all regular teachers having options to take advantage of 
the facilities. Alpha was the successful' respondent to the Eequest for Proposal issued 
for a program for the Elducationally Handicapped at Coldbrook School. Alpha will 
also be providing management support for instruction at Fountain and Kensington 
Schools, will set up a workshop on behavior modification for reading teachers, and 
will be assisting the district in studying alternative education for drop-outs. 

District management of all contracts will be centralized under Mrs. Webster, 
who will be Coordinator c»f Contract Learning. She will report directly to Dr. Vrug- 
gink. 



IMPLICATIONS OF A DISTRICT’S ROLE IN SECURING 
A SUCCESSFUL PROGRAM 

It appears that the success of any innovative instructional program greatly 
depends on the manner in which the district approaches the project. Performance 
contracting seems to bring certain aspects of public school systems into sharp focus. 

The results of its 1970-71 experience have a number of implications for Grand 
Rapids and for many other school districts. Without trying to be exhaustive and with 
no desire to laboriously plow well-tilled fields, we may briefly discuss several conclu- 
sionrs that appear to be justified concerning (1) the need for tightening contract 
specifications, (2) strategies for building enthusiasm among district personnel, and 
(3) characteristics of district organization and policy. The intent is to identify some 
of the less obvious policy considerations as they relate to performance cont’*acting. 



I 




Tightness of the Contract Document 

The safeguarding virtue of the contract depends on how well it is constructed. 
In drafting the contract, the district should remain skeptical of the contractor’s 
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theories regarding patterns of achievement gains, the declining importance of ex- 
trinsic rewards in contingency management, the development of pupil self-manage- 
ment, and the like. One should judge how the program will be affected (teacher 
workloads, for example) if one or more of these constructs do not work out as 
expected, and how the contract should handle such eventualities. 

No matter how theoretically promising the program or experienced the contrac- 
tor, it is wise to have the flexibility to modify in midstream. It is to the credit of both 
WLC and the building administrators that they acknovff edged the boredom of the 
younger children and the potential for wider school involvement in the centers, and 
were free to make constructive changes at midyear. 

Anticipating Contract Anomalies and Changes. The contract may only 
appear to havet very explicit terms of payment; if so, a few conti'act violations or 
misunderstandings on either side can easily turn payment into a matter of negotia- 
tion. There should be speciflc remedies for contract violations. The team-like togeth- 
erness of disf.rict and contrac^tor during the school year may evaporate at payment 
negotiation time. Most problems can probablj/ be avoided by using realistic contract 
premises and specifications (e.g., minimum days per school year, maximum absences 
per pupil, and conditions for rejecting program participants). The contract should 
minimize the situations which fall under the rubric, "all normal administrative 
procedures W’T be carried on as usual.” 

At the start of the school year in Grand Rapids, for example, the payment 
provisions in both the CMES and WLC contracts seemed straightforward. As the 
year progressed, it became clear that liecause of testing difficulties and absenteeism, 
large numbers of the participants would not be eligible for inclusion in payment 
formulas. Neither the district nor the contractors were happy about the situation, 
but the remedy Involved new questions that had not been addressed in the contract 
(e.g,, "For payment purposes, would it be fair to pro-rate the g ain s of chronic absen- 
tees across the days of actual attendance?”). 

Analyzing Factors that Bear on Payment. Factors that bear on payment 
should be analyzed, especially the tests to be used and the particular score-scaling 
with which results are reported. There may be problems in giving scores validity if 
the test level does not match the age level of participants, or if pre- and post-test 
scores are not strictly comparable (e.g., first grade pre-tests for which there are no 
grade equivalencies). If payment involves specific grade objectives, as in the WLC 
program, the district should know the formula and rationale behind the objectives. 

Payment criteria should reflect all program objectives in which the district is 
seriously interested, including elusive noncognitiye goals. There has been little 
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successful experience in measuring changes in student attitudes, or even in ar- 
ticulating what speciflc attitudes are important in different situations. A district 
might give impetus to experimentation by making attitude change a real, though 
small, factor for payment. 

Selection of Participants. In selecting pupil participants, there is more to 
consider than achievement level. If a program aims to introduce individualized 
instruction without lowering the student-teacher ratio, it probably involves a highly 
systemized approach requiring a measure of self-reliance on the part of participants. 
Some pupils may not function well in this environment and, if included, the contrac- 
tor will probably insist eventually that they be rejected from the program. There is, 
for example, the disruptive "problem child” who drifts along in regular classrooms 
at the expense of other pupils. If the contract learning setting does not accommodate 
drifters who fail to be motivated by the program, the child suddenly becomes a 
problem that can no longer be ignored or passively tolerated. Consequently, even 
though the school may be relieved from providing for lower achievers, it may still 
be obliged to make special arrangements for "problem” pupils. 

The On-site Program Monitor. The performance contract presents a need 
for management planning (specifying who is to be responsible for what, and what 
is to be his sphere of authority). For example, the role of the performance contract 
on-site evaluator (or program monitor) is often assigned to a building administrator. 
This has advantages and disadvantages, depending on his personal characteristics. 
The building administrator is naturally familiar with his school, but he may have 
limited authority in a large district. The program monitor should be someone who 
can devote a considerable portion of his time to that function, if he is to provide 
evaluation for program improvement as well as contract control. He should be 
independent enough from the school to avoid convenient "clubbiness” with contrac- 
tor personnel. He should report directly to whoever negotiated the contract and not 
through ambiguous chains of command. He should be in a position to act as an 
expeditfjr, especially during the program start-up period. The cost of a district 
program monitor is a signifleant but appropriate program cost. 

Strategies for Building Enthusiasm Among District Personnel 

Much has been said on the theme that the turnkey phase may be headed for 
failure without the schooTs active support, enthusiasm, and commitment to detailed 
planning. These same attributes may be the overriding factors for success of the 



performance contract phase, especially at the building administration level. There 
should be a real effort to make the principal rAiore than a disinterested observer, for 
he is the key man if the innovative program is ever to be integrated into the school’s 
regular program. Somp principals may view such involvement as merely part of 
their jobs, while others may see it as extra burden. 

Channeling Ambition. Since the performance contract and its accompan- 
ying instructional technolo^ may be regarded as part of the frontier of the educa- 
tion profession, some may actively participate to promote their professional growth; 
this could be true of teachers, principals, and middle level administrators. Accord- 
ingly, the district might adopt the strate^ of channeling the ambitions of key 
personnel as a route to expediting a program’s success. Certainly, last year in Grand 
Rapids there were several hard-working key people who were at least partly moti- 
vated by professional advancement. 

A school district should recognize this factor and learn to profit from it, Of 
course, there is a danger of alienation of allegiance from the school to the contractor, 
especially if the person in question is buried in a large school system. The larger the 
organization, the less there will be personal identification with policy, and, presuma- 
bly, the more susceptibility there will be to temptation. Certainly, persons thus 
motivated should not be cast as evaluators. As for teachers and administrators, the 
main cost to the district is that the ambitious ones may soon move on to better jobs. 

Influence of Learning Center Staff. The single most important person relat- 
ing to technical success — ^achievement of program goals — is the one who heads the 
program at the building level. If the school has only one learning center, that person 
would be the learning center teacher, or supervisor; in a larger program, he might 
be the on-site manager. Whoever he is, he sets the tone of the whole program in that 
school. To a large extent, pupils and regular staff will judge the program on the 
merits of his technical and interpersonal abilities. In one of the GRS contract learn- 
ing programs, for example, there seemed to be a marked difference in how the 
regular staft perceived the success of two of the program’s centers, although achieve- 
ment gain was about the same for both. It was alleged that mismanagement pre- 
cluded success in one of the centers, whereas remarks about the other were gener- 
ally positive. 

Catering to Perceptions of Regular Staff. Teachers have their own view- 
points that may tend to distort their perceptions of instruction techniques. However, 
assuming a pupil-oriented system, teachers are on the front line. Their attitudes go 
a long way toward molding the system’s effectiveness. Perhaps pragmatic manage- 
ment (which may have predilections of its own) should more often accept these 





perceptions as "facts of life” and avoid squaring off with teachers over innovative 
programs. Accordingly, management’s alternatives would be to (1) accede, (2) design 
and administer new programs so as to avoid conflict, or (3) remold (through training, 
propaganda, and involvement) teachers’ perceptions to align more closely with those 
of management. 

Hierarchal Myopia. One factor that has played an observable role in the 
management of contract learning might be termed hierarchal myopia— that is, the 
visibility from any level in an organization tends to be hazy for any but adjacent 
levels. When conflict arises in the lower echelons, an administrator may seek to 
make his own life simpler by siding with the nearest party to the conflict in the chain 
of command. This was the alleged situation with a series of conflicts that arose in 
one school between contractor personnel and the regular teaching staff; one of the 
regular teachers felt that the on-site manager adjusted his policies to keep the 
program teacher happy, rather than rely on the judgment of his own experience. 
Another teacher felt that the district made only cursory efforts to obtain teacher and 
student evaluations of the contract learning programs; to be fair, it should be re- 
ported that one district official felt that student and teacher coverage was ample. 

Of coui’se, myopia also hinders upward vision, but since this section is oriented 
toward management, the premise is that management has the burden of under- 
standing. 

Characteristics of District Organization and Policy 

One can safely assert that many aspects of public education diverge more or less 
from the ideal; given the political and social context, these aspects manago to stay 
submerged without arousing too much attention. Performance contracting has a 
way of bringing some of these to the surface where they pose direct problems. The 
most obvious, for example, might include the state-of-the-art of testing and measure- 
ment, evaluation practices, and questions regarding the long-term effects of contin- 
gency management. The following pages focus on some of the more subtle problems 
that may arise from the way the district is organized and managed. 

Entrepreneurs and Public Education. The most pervasive of these prob- 
lems seem to arise from the whole process by which a school system sets its goals, 
chooses and implements strategies, and measures and evaluates performance. 
School systems typically state goals in terms of generalities, largely because it is 
simply too difficult to articulate their mandate in terms of explicit performance 




(oxcept, perhaps, for cognitive growth). Strategies are adopted on a piecemeal pro- 
grain-by-prograni basis, and perfbrmance measurement seems to be limited in terms 
of both what is measured and how it is measured. Performance contracting, on the 
other ht , functions most smoothly when administrators close the loop among 
goals, strategy, and evaluation. 

The interface of private and public enterprise through the performance con- 
tract obliges the school district to adopt business-like attitudes from the board of 
education on down; more decisiveness is required than is usually found in the public 
education machinery. Public education is a Constitutional mandate, but individual 
private enterprise generally exists by virtue of profitability; it should not be surpris- 
ing to find the former at a disadvantage in the latter’s ballgame. 

Source of Funding Versus the PupiFs Interest. The Grand Rapids Scliool 
System is probably more pupil-centered than most (as refiected in its broad range 
of special instructional programs. Continuous Progress Programs, etc.). On the other 
hand, in some ways the administration appears to be organization- and budget- 
centered. Source of funding plays an important role in determining how much 
interest an instructional program will generate in the superintendent’s offices. For 
example, of the three contract learning programs, there was much less interest in 
formally evaluating the Alpha program because its funding (and presumably ac- 
countability) was outside the control of the district. That this funding effect is not 
unique to Grand Rapids is reflected in a CMES executive’s statement that, starting 
in 1971-72, CMES will not enter into new contracts unless they are largely financed 
from operating funds. 

Information Flow. The generation and flow of information can be criticized 
in most organizations, and Grand Rapids Schools are no exception. As has been 
already mentioned, there is difficulty obtaining certain planning and evaluative 
data from the top to the bottom of the hierarchy. 

Information exchange at midadministrativ© level within the district seems to 
be further hindered by conflicting interests, however subtle. This underscores the 
need for top officials to seek out countervailing opinions on certain issues. 

Information systems are bulky and not easily changed, and it is understandably 
impossible to anticipate everyone’s needs. It might be useful; however, for the data 
processing personnel to keep a journal of nonroutine data-requests as a reference 
for future modifications of the system. 

Administrative Procedures, Procedures laid down by school administra- 
tions are sometimes characterized as barriers to education. A recent position paper 




of the Michigan Education Association has attributed part of a performance contrac- 
tor's success to the notion that "he brings to the school a well thought out system 
and operates the system free and unencumbered by the school administration of the 
district." A Grand Rapids School administrator has been quoted to the effect that 
the contract learning programs can circumvent the district’s procurement red tape, 
and therefore are more responsive to needs for materials and equipnrient. Another 
administrator has countered that regular district instruction does not have as much 
money at its disposal. Perhaps the lesson is that the district should try to rearrange 
priorities somewhat to allow teachers greater flexibility in acquiring instructional 
materials. Materials are an integral part of instruction (along with staff, facilities, 
etc.), but they lepresent a small fraction of the budget. The district might, therefore, 
get a lot of mileage from a relatively small increment of funding in this area. 

Research and Development. Grand Rapids is probably among the leaders 
with respect to organized testing and valuation. Even so, Grand Rapids might profit 
from a more broadly based and systematic program for testing, evaluation, research, 
and training. As in most districts, copious data seem to be collected that receive only 
cursory analyses. On the other hand, there are some student data that are not 
centrally collected but which could usefully enhance interpretation of district test 
data. 

It would seem that more could be done to provide meaningful feedback to the 
building level, perhaps supplemented by formal in-service training in problem 
areas. One building administrator has commented that the district often initiates 
new profframs with much fanfare, but fails to provide adequate follow-up evaluation 
and retraining. 

The present line-item budgeting makes it very diflicult to extract certain kinds 
of planning and evaluative information. There is no way to get a good feel for the 
costs of different areas of instruction, for example. Thera also is no way to determine 
what the district pays for evaluative and developmental activities; some line-items 
are exclusively in these categories, but unspecified fractions of many more line-items 
are also involved. Grand Rapids Schools are now exploring program budgeting, 
which may enhance both their pupil-centered orientation and their administrative 
effectiveness. 

Data Quality. If a larger evaluation budget brought about increased utiliza- 
tion of data, there would be a parallel need to monitor the quality of the data itself. 
Leaving the intractable content-validity issues for the theorists to debate in the 
journals, there is the straightfoi'ward matter of precision — that is, how carefully the 






measurements were taken and the data collected. The most rigmous analysis is 
helpless in the face of data that have been cavalierly assembled, and this is generally 
the case with data that are collected at building level in response to obscure memos 
from higher up. In such cases, the evaluation staff should conduct periodic data 
audits down to the lowest level of collection so as to verify data accuracy, but, more 
important, to impress on the data collectois that accurate aAla on’ inportant. 

Community Relations. Innovative arrangements, such as performance con- 
tracts, often spotlight community relations, either because this is a condition stipu- 
lated by the funding asency, or because school administrators are uncertain of 
public reaction. Asses-sing the public interest on such occasions may merely verify 
a pervasive detachment from school affairs in general, as was found in the South 
Middle School attendance area. One suspects that effective community relations 
require a cr ‘inuous ongoing program rather than the piecemeal efforts occasioned 
by iunovative instructional programs. As an aside, one wonders how much parent 
support is dissipated by report cards that parents do not understand (e.g., Continual 
Progi ess and WLC parent reports). If the district is courting community support, 
perhaps it should con sider modifying report forms to ease the burden of understand- 
ing. 



PERFORMANCE CONTRACTING AS CHANGE.AGENT AND 
SAFEGUARD 

One of the main benofits of the performance contract appears to be its useful- 
ness fbr introducing innovations in instruction. This seems to have been the overrid- 
ing consideration in Grand Rapids. At the beginning of the 1970-71 school year, one 
school administrator commented that contractors offer nothing new in the state-of- 
the-art, but that Grand Rapids Schools generally do not have the wherewithal to 
initiate such innovation themselves. The contractor offers a package backed up by 
its research and organizational capabilities, capabilities that are more specialized 
and aggressive than might normally be found on a school district staff. The organiza- 
tional capability is very important; Dr. Vruggink, the Assistant Superintendent for 
Instruction, has commented that the important ingredient "may not be the system, 
but merely being systematic.’’ The performance contract also has an aura of ac- 
countability, which might be contagious, and it imposes demands for good financial 
planning information that may otherwise be unused or even ungenerated. 
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The performance contract also gives the district some control when dealing 
with a contractor who is relatively unknown or inexperienced. The research and 
development that the district is buying is not really completed until the program 
is successfully installed in the district’s schools. A district can be reasonably certain 
that the innovative program will be in some sense exploratory during the first year 
of implementation. This may mean minor modifications to accommodate the par- 
ticular characteristics of the hos- school or broad revisions of program components 
that simply do not work. In one school during 1970-71 (not in Grand Rapids), it 
appears that the contractor had not developed part of its program beyond the 
conceptual planning necessary to write the contract. In any event, the performance 
contract provides assurance that the contractor will be actively involved throughout 
the year in searching for improvement. 
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Appendix A 

INTERIM REPORT TO THE BOARD OF 
EDUCATION 



PERFORtfMCE CONTRACTING PROGRESS 
April 2, 1971 



Data 

ALPHA LEARNING SYSTPIS Company Ifanager - John Cline 

Project Director - Joan Webster 

100% by Office of Economic Opportunity 

A, West Middle School 

1. 100 students in each of grades 7, 8, and 9, 

2. 3 certified taachars, 4 educational ald«B, 

3. Reading and Math - 45 minutes each per day, 

B. Hall School and Alexander School 

1. 50 students In each of levels 1, 2, and 3 in each school, 

2. 2 Alpha teachers, 2 educational aides. 

3. Reading and Hath and Freoroom - half day. 

Two-week intensive workshop in August for taachars and aides with 
emphasis on behavioral psychology and contingency management , 



Tasting ; 
Name : 

Financlns * 
Sites; 



]ta-Service ; 




Site; 



In-Sagylce ; 

Testing ; 



•Battelle Testing Company, hired by O.E.3. Contract calls for no 
release of Interim results until project Is completed. Burton, 
Slgsbes and Straight are being used as control schools. 



WESTINGHOUSE LEARNING SYSTEIIS Company Manager — Jack Goldberg 
Title I and Section 3 

A, Lexington and Pranklln Scaools 

Started as half-day program In Reading and Itath In September 
for 110 students at each site. CS5 students in A.M. and 
55 students in P.M.) Time was considered long for early 
elementary , so was changed to 1-1/4 hour sessions at semester. 
This also gave an opportunity for all students and teachers to 
participate , 

B. Sibley and Straight Schools 

Started at request of staffs in January, Diagnostic and 
prescriptive service pufchased only for a flat rate. Whole 
staff involved. Upper elementary only at Straight School, 

August 1970 in Behavior Analysis and Itanagement. 

Metropolitan Achievement Test administered by our own 
Testing Dapartment , 



COMBINED MOTIVATION EDUCATION SYSTHIS Company Manager 

Claybeon Coleman 

Modal Cities, Section 3,' and Title I. 

A. South Middle School _ 

1, 500 students In grades 6, 7, 8, and 9. 

2, 4 teachers, 9 aides. 

3, Reading and Math 45 minutes each per day. 

Tvro weeks In August for teachers and aides. 

Scholastic Tasting Service adrolnlstered by our otm Testing 
Department , 



General 
comments i 


All programs practice some form of relnforcanent system 
(contingency managanent). None are tied into their own 
hardware or materials systM, but put together combinations 
of existing materials from various SQurces. 

0*E,0* has contracted with Battelle Institute to sample test 
all programs including our Project Read. 



Subjective cotw 


mants -- School personnel 



ALPHA 



Principal 1 


A big change In work^study habits. Discipline and control is 
much easier. Improvement in Individual self-control: "They 

don't have to fight to build their ego, they build selfesteem 
and positive self-concept by a study task. ■■ 

It is a consensus of the Alpha teachers and myself that the 
greatest weakness and inadequacy is in the readiness and early 
primary areas which need restructuring in both reading and math. 

The testing situations at the beginning of the year for certifi- 
cation and placement got us started off In negative fashion due 
to poor planning, preparation and orientation of testers and poor 
grouping for testing of children by Battelle Memorial Institute, 


Principal 1 


The things I like about Alpha are the positive approach, the 
consistency, the effort, the motivation and continuity that 
has been maintained as a daily process to make the program 
really work by the Alpha teachers and aides. 

Also, possibly instant reward if retention and recall are 
apparent and serves to stimulate desired responses. 


Teacher : 


The positive reinforcOTent approach, using the token econcrny 
and social reward aystra, "has been very effective with ahnost 
all children - a real "turn-on" particularly for the uranotivated, 
undarachlevlng child . " 

Some of the kids get so "turned on" in the progranmied materials 
that they don^t want to stop to go to the free room or to recess. 


Social Workers 


One of our boys who has been unable to function Cllttle self- 
corAtrol) In regular class, is really working. 



Parents t 

Students i 
Director i 



RecomTnendatl 
Hall School: 



WESTINGHOUSE 
Principal I 



Response at conferences was "positive*" JIany parents have told 
Alpha teachers that they can see a big change in behavior and 
attitude at home. 

"I didn’t taiow 1 could sound^out words like that"* 

The subcontractor is meeting the terns of the contract in pro- 
viding the required pre-servlce and in-service training to the 
staff I providing the necessary curriculum materials | preparing 
the Interim Performance Objective Teats ^ and working with th.^ 
project office in all contractual areas* 

The students appear to be progressing at a satisfactory rate* 

It has not been determined if this is a result of the teaching 
methods and curriculum or the Hawthorn effect • • 

There is concern that flow charts do not adequately cite individual 
student progratming as do the Westlnghouse modules of study. 

s 

We would propose the continuation of the program with the imple- 
mentation of the changes suggested earlier in this evaluation 
regarding staff. 



In-service workshops are essential for all teachers and aides who 
will be Involved in any extension of the program into the inter- 
mediate levels* 

Revise the early primary curriculum and materials . 



In my estimation the program is going vary well for later 
elementary children. The very young children 5 however j do not 
seam to be profiting by this approach* 

There are many important aspects to the Westlnghouse Program 
that are not found in the traditional classroom* Probably the 
most important of these Is the individualized Instruction which 
simultaneously meets the needs of all students* 

Are we sacrificing effective group work — forcing children to be 
too independent? 

Is there more to reading than skills? 
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Principals 



Principal I 



Taachars! 



Parents i 



Some of the staff still are dubious about the future of the 
program in the school « They still need to be assured whether 
we are going to stick with the program long enough to see it 
through* There have been many programs in the past that were 
"here today and gone tomorrow," 

One basic fault is that there are no trained substitutes whan 
the teachers or center staff are absent* Cost could be one of 
the reasons for this program* Having the teachars work in the 
center with children has changed their perspective from a "them" 
"we and them," 

The attendance of some of our regular "school skippers" has 
Imroved Attenance is considerably better for the half* 
day the students are in the canter as opposed to the half=day 
spent in the regular classroom* 

They all love the reward system* Almiost all of them seem to 
have a greater Interest In school. Out of parents of 31 
children, 28 felt the program was really helping their child* 

Nice that all children on these levels attend the program, 

Some of the people don’t understand the program* 

Most comments at conference time were favorable. Parents of 
the slower learners and underachievers were in my estimation 
the most pleased. They have been noticeable lmprov«nents in 
their children at home, also attitudes toward school and toward 
themselves , 

Almost all parents who cme for conferences ^pressed a strong 
desire that Straight will have the Learning Center again this 
fall. 

One family was happy their daughter was in the program where 
she could go and go. 

A parent didn’t approve of bribery though daughter skips school 
less often, beeause she likes the center. 

My child Is a lot happier in the Learning Center* He enjoys his 
work. 

My child doesn’t want to be absent In the P,M,, so she wouldn’t 
miss going to the Learning Center. 
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I wish they'd had a progrm like this when I was in school. 

Not for every child, 

I don't like the pool table. 

Students I A typical day? Work^ works work. 

Math is the program that is helping me because it is a program 
that la fun, 

I like everything in it . 

This is the first time I have aver enjoyed achool, 

1 hate the Learning Canter because of the work. 



C/MES - COMBINED MOTIVATIONAL EDUCATIONAL SYSTQIS 

Principal I Many atudents are benefiting from the individualized in- 

struction, Iteny are learning to work on their own and to 
accept their share of responsibility for their academic 
success 5 which is as it should be. 



The most poaltlve aspect of the program ^ 
Achiav^ent itotlvatlon Session. 



as I sea it , is the 



The claim that the C/tffiS program would motivate students and 
minimise truancy has not been substantiated at this time. 

This first year*s operation has had many probl^s ranging from 
late completion of the centers to equipment failures and late 
arrival of matarlali. The majority of the problems have been 
or are being alleviated. 

However, a prevailing feeling or the part of the personnel in 
the program seems to be that the school serves the program, 
rather than the program serves the school, C/lffiS progrOTi is 
seen by many as a separate operation rather than a part of 
whole. Much more coordination of efforts between the project 
director, C/lffiS personnel and the rest of the building staff 
is needed. Also, strong effort in public relations is necessary. 

Principal: 1 can see alternatives in the C/MES that would not be offered 

in our regular program. The prescrlpttva or tndlyldualized 
aspects of the program are tr^todous. 
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This aspect alone offers "another chance" to a student^ lack- 
ing a mat. or reading skilly on his own levels I also feel 
that a second year program is seriously needed at South Middle 
to eliminate the experiJaental or guinea pig stigma attached 
to the numerous programs tried here,^ 



Comments — Company Personnel 
KLPm 

Alpha is the only company that we know of which uses no hardware at all. 
Without proffering a subjective argument concerning the psychological 
effect of machines on children I would only point out that Alpha ^s non— 
reliance upon hardware offers two distinct advantages over all other 
companies s (1) Lowest possible capital demands for starr“"up and (2) Freedom 
from problem of machine maintenance and obsolescence. 

Alpha is also a unique Contractor in Its persistence in working toward true 
turnkey. All of our efforts with Grand Rapids personnel have aimed toward 
training these people to operate autonomously with absolutely no further 
reliance upon Alpha services in years following turnkey. We feel that 
Grand Rapids would seriously be compromised if there were an ongoing depen- 
dence upon Alpha for any services, 

t-JESTINGHOUSE 

The Operation of the four Learning Centers is going very well^ Based on an 
objective evaluation as done by our support services , the projections for 
actual achieVTOent should be comfortably raached. We have developed a pro- 
cedure which takes into account the nimber of lessons actually completed by 
the children in the Learning Center in order to develop an objective measure- 
ment. 

While the Learning Center focuses directly on cognitive skills ^ we are sure 
that there Is also a tremendous effect on the affective ^perlence of the 
children invo'^ved. While this is certainly not a measurpable characteristic 
it is none the less very toportant. With respect to this element ^ we are 
making efforts to adjust our positive reinforcement system away from direct 
and immediate self-gratification and direct it toward a more broad based 
sharing situation, 

Q/ms 

The instructional component i (both reading and mathematics) j although In-- 
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augurated late and under lass than favorable conditions s has won wide 
aecaptance and support mong students. Diagnostic testing, IndlvldualiEed 
prescriptiona, self “instructional progranmed materials, and dlvarsified 
teaching machines (hardware) are just some of tha unique aspects of the 
instructional program that has caught tha imagination and interest of the 
students . 

The Achievement Motivation Program, to data, has baen successful in halplng 
the students to become more cogniMnt and knowledgeable about themselves 
and their peers. It has made them more aware of their experiences, former 
successas, strengths, values, conflicts, and the types of rewards they seek 
for I : inf or cement , 

Combined Motivation Education Systems Is pleased mth the overall progress 
and impact that the program has shown at this point and are confident that 
even more extensive and definitive progress can be made in the ensuing 
months and year. 



IV t Available Objective Information 

ALHIA : 

Contract provisions with the federal goverranent prevent release of infor*- 
mation, but results indicate growth in proceeding as ^pected. The following 
language is in our contract BIC-5217, 

All such data, test scores and records directly connected to the performance 
of the progrOTi is the property of the Office of Economic Opportunity and 
shall be kept strictly confidential by the Contractor in accordiance with 
established laws and regulations governing the Contractor In such matters. 

The Office of Economic Opportunity shall have the right to make public 
group infomation where necessary In the furtherance of this experiment^ No 
such Infomatlon shall be made public by the Contractor or its subcontractors 
until approved by the Office of Economic Opportunity, 

WESTINGHOUSE i Attached graphs 

Franklin “ After 90 days, the total achievement years for 110 students 
was 185 “ 80 in mth and 105 in reading* This would be an 
average of ,73 In math and ,95 In reading, 

Lexington After 90 days^ the total achlevenyant years for 110 studenta 
was 210 ^ 100 In math and 110 in reading. This would be an 
average of ,9 in math and 1,0 in reading. 
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It should be cautioned that these figures are based on 
Wastlnghouse projections. Their experience Indicates a re 
lationshlp between modules completed and achievement years 
They do not claims however j that the relationship is 100% ^ 

0/mS i 

A sample of Grand Rapids pupils in grades slxs seven, eight and nine 
was tested February 10, 1971, with the Elementary Form B EDS reading 
and mathematics tests as an Interim progress check for the CME8 program^ 

The total number of atudents tested was 129, 51 at the sixth grade ievel, 

32 at the seventh grade level, 37 at the eight grade levels and 9 at the 
ninth grade level, 

Reading test results i The average gain of the pupils in residing was 
approKlmately 5 monthe, or one half year* The iargest gains were made 
by sixth and seventh grade pupils, who, on the average, made almost seven 
months' gain* In terns of the performance of individual students, it is 
noted that over 2/3 of the students are making some gains, about 1/2 are 
making gains of more than 7 months, and almost 1/4 of the students have 
made gains of one year or more on the reading test. All of these reported 
gains have been made in approximately 4-1/2 months calendar ttoe, though 
the actual Instructional time was probably closer to 3-1/2 months due to 
various delays encountered at the beginning of the year. 

Math test results i The gains on this interim testing In math follo^^ 
somewhat the bbssb pattern as those reported above for reading. The overall 
average gain for all 129 pupils is approximately 5 months, ^aln, the 
sixth and seventh grade students showed the greatest gains, averaging al- 
most seven months. 

It is difficult to Ject what the final gains will be slnca learning, 
as measured by teats, does not always occur in a straight line pattern. 

In addition, standardized testing approach does not al^ys do full justice 
to the progrma. In reading, for instance, the standardized teats used 
taeasure only the child’s comprehenilve skills, whereas the progrfflt to 
the early stages placed much heavier raphasls on word recognition and 
work attack skills. 

Similarly, it la felt that the scores on the mathematics test are a low 
estimate of the actual mathematics ability of these chlldran. The 
mathematics test requires a great deal of reading, and It is felt that 
many it^s on this vest were miased, not because children did not Imow 
the mathematical principles or operations involved, but rather because 
they could not read the questions. As their reading abilities continue 
to toprove, it felt that their real mathematical abilities ^11 be 
more accurately assessed . 



Overall, the staff has been satisfied with the various progrms and have 
reason to believe that techniques used will have positive implications for 
future programs in Grand Rapids. 



Elmer H. Vragglnk 

Assistant Suparintendent for Instruction 
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RECOMMENDATIONS OP THE CONTRACT 
PROGRAMS COMMITTEE 



TO Hr, Philip Runklej Superintendent of Schools 

FROM Contract ftfagrans Comaittee 

SUBJECT REaOtD®IDATIONS FOR 1971-78 BOKOOL reAH 



## recoHffliend that the existing perfon^ce □antraetlng centers be 
maintained fer a second year ©n a eompany-management basil without 
the paid parformanee guarantee* This would be seen as a first, step 
toward a coaplete twrAey of the operation to Sianagement by the lociJ, 
ichool system* The schools now having these centers should have the 
option of extending the center' services to other age groups and achieve 
nent levels vlthin their buildings. This recommendation is purely a 
subjective evaluation , not based on test results since none are avail- 
able at this time. 

Our decision was reached after conferring and censultlng with teachers, 
principals I and the compwy representatives* The committee also made 
on-site visitations^ sampling the attitudes of the students while on 
location. 




Wt thought it best to reeonmend a eontinuation of idl three progrMS 
for another yearp rather thm a eeleetion of one program ovtr the other 
tvOj ainee mo^t people yere quite impressed with their partleular eon-- 
tract program. It is also the thinking of many eo^mlttee members that 
it la difficult -to adequately evaluate and realize the full effeetive*- 
pass of a contract program in Just one year. 

The committee likes the philosophy of the contract programs. They are 
seen as a means of implementing iomethlng new and different » and as a 
catalyst for educational reform. Other factors which brought about 
this reCQBimendatlan are the management system, cost effectiveness, 
accountability, and the behavior^ objectives. 

Kie follo^ng persons served on this eomltteei 



Tom Jackson 
Dorothy Johnson 



George Portfleet 
Fern Kofffeaster 
44ary Edmond 
Joan Webiter 

William Kirkwood, Chairman 
Dick Bandy, ex^ officio 
Elmer Vruggirdc, ex officio 



Jackie Deeb 
FrwA Pulte 



Georgia Thompion 
Alice Huwer 



cc Initructlonal Comcil 
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Appendix C 




READING 



1. Raading Raadiness 
Ivastinghouse Learning Corporation 

2, M* W# Sullivan Raading 

A -- Dj 1-20 plus cassettes 
Behavioral Research Laboratories 

3- Lis tan and Think 

.Lesson Books C, D| Eg F with cassettas 
Educational Developmental Laboratorias 
Division of McGraw-Hill 

4. Tapes Unllml.ted 

Educational Unllmi ted Corporation 

5. Reading Skill Text 

Sarlesi Nicky, Pat the Pilot, Uncle Ben, Tom Trott, Uncle 



Charles E, Merrill Publishing Company 

6. Phonics Skill Text Series 

Books A, B, C, D with cassettes 
Charles E, Merrill Publishing Company 

7* Programmed Phonics 
Books 1 and 2 

Iducators Publishing Service Incorporated 



Funny Bunny with cassettes 
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8* Lessons for Self Instruction in Basic Skills 

For eKamp.^ei Raference Skills, Following Diractiona and 
Reading Intarpretation 
California Tent Bureau 
Division of McGraw-Hill Book Club 

9s Reading for Understanding 
Science Research Associates 
Pilot Library IX C 



HATHEItoTICS 

1, Fitshugh Plus Program 

Allied Education Council 

2* Seeing Thru Arithmetic 
Workbook Edition 
Scott Foresman and Company 

3s Incroductlon to Modern Mathematics 
Behavioral Research Laboratories 

4. Fractions III 

Webster Division, McGraw-Hill Book Company 

5. Introduction to MultlpllcatlojL 

Webster DlvlslonjMcGraw-Hill Book Comrany 

6. Programmed Matiiematlcs 
Sullivan Associate Program 
McGraw-Hill 

?• Introduction to Mathematics 

Encyclopedia Brltannlca Educatlcnal Corporation 

S, Modern Mathematics 
Grades 1, 2, 3, and 4 
Continental Press Incorporated 

9s Ms Ws Sullivan Mathematics 

Behavioral Research Laboratories 

10. Drill Tapes 

Science Research Associates 

11. Mini System 

Learning Systems Corporation 

12. Modern Arithmetic 
Grades 1-5 

Mllllken Publishing Company 
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13, Modarn Mathematics 
Grades 1-5 

Hayes School Publiahing Company Incorporated 



14 , 



15. 



16, 



<• 



Modern Algebra 

Encyclopadia Britannlca Educational Corporation 

Basic Mathematics and Problem Solving Approach 
Addlson-Waaley Publishing Company 

One to One Corre.^pondence and Conceptualizing Numbers 
Weatinghouse Learni | Corporation 
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Appendix D 



THE WLC-GRS CONTRACT 



This Agreoment, dated July 1970] jg between (1) Grand Rapids 
Public Schools (SCHOOL), 14S bosewick N, E,, Grand Rapids, Michigan 
49502, and (2) MestinghousG Learning Corporation (WI,C) a Delaware 
Corporation with headquarters at 100 Park Avonuo, Now York, New York 



It contains all the terms and conditions undor v/hich WLC will provide, 
and the SCHOOL will purchase and use, the V/LC Learning Center Program 
(PROGRAM) during the 1970-71 school year, 

1. Background and Purposo 

The PROGRM4 has bean developed by a team of psychologlstSs educators 
and systems managers during a period of several years of research and 
development effort. It is a program for the systematic and effective 
management of learning, valuable for remedial, regular, and enrlchmerit 
purposes, completely individualized, and selfpaced. In operation. It has 
five major elements or phnscs; 



““Diagnosis, ITie student's strongths and noeds arc identified 
through a varloty of tests designed to establish what he al- 
ready knows and what ho noeds to learn, 

--Prescription, A course of study is plannod for each student, 
specially designed to take advantage of his present achievements 
and to concentrate on the areas of his greatest need. 
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--Loarning Materials. Each unit In the course of studies refers 
the student to learning materials that have been selected as 
balng most effective or efficient for hini to use in learning 
the content of that unit. 

^^Motiva tion. Each student participates in a system for planning 
and schadullng his study program; in this way^ he le^arns to 
assume increasing responsibility for the objectives and the 
nisnagement of his own works of his study program, and this in 
turn motivates him to accomplish it successfully and well. 

--Evaluation, Progress tests monsurc the studont-s achievement in 
reaching his learning goals. These measures of achievement are 
used for following and aiding the student's progress. They are 
also the basis on which the PROGRAM is judged and paid for. 



Under this agreement WLC will establish and operate two Learning Conters 
in Grand Rapids, one in the Lexington ElcnicnLary School and one In the 
Franklin Flcmentary School. Tiic objective of the PROGRAM to be operated 
in the Conters is to provide anstructLon in math and reading so that 
students performing below grade level in these subjects will p^agress to 
perrormnnee levels at or above grade level by the end of the sdicel year. 

2, Preparation 

A. To prepare for tlic opeming of the Centers and for the operation 
of the PROGRAM, WLC will do these things; 



( 1 ) Not later than [15 July 1970] vM will provide the SCHOOL 
with a complete and detailed description of the space and 
furnishings required to operate the PROGRAM so that the 
SCHOOL will have sufficient time to make suitable space 
ready for the PROGRAM prior to the beginning of the school 
year. 

(2) WLC will assign from its staff a manager who will have primary 
responsibility for the entire PROGRAM and a senior pro- 
fessional (who will be in charge of the second Center) to 
operate the PROGRAM. It is eKpectecl that each Center will 
have at least two additional staff members. One of these 
will be a teacher assigned to thio Center from the SCHOOL 
staff and paid by the SCHOOL, WLC will also employ one or 
more aides In each Center, It is uuderstood that the number 
of aides on duty in a Center at any time may be adjusted 
according to the number of studiints in attendance, WLC will 
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provide all training required for all teaclHirs and aides who will 
be working in the PROGIiAI-l. 

{3) WLC will furnish all educiitional equipment and all educational 
and motivational ninturials required for use in Che PROGRAM. 

(Tills equipment and these materials will remain the property 
of WLC.) 

B. To prepare for the opening of the Centers and for the operation of 

the PROGRAM, the SCHOOL will do these things: 

(1) The SCHOOL will make available in the Lexington Elementary 
School and the Franklin Elementary School suitable space for 
a Learning Center to accommodate up to 50 students. The 
space will bo made ready not later than 20 Aug, 1970 to meet 
the requirements of the PROGRAM as described by WLC, The 
SCHOOL will also make avatlable adequate office space in or 
near one of the Learning Centers for the use of the WLC staff 
manager and his secretary. The SCHOOL will providG all 
furniture (tables, chairs, desks, etc.) for the Centers and 
for the WLC manager’s office. 

(2) The SCHOOL will select two teachers from Its staff - one to 
work in each Learning Center, and the SCHOOL agrees that WLC 
will have an opportunity to participate; In and approve of 
their selection, Tlie SCHOOL will arrange for the teachers 
selected to be available for training at least two weeks beford 
the start of the school yenr, 

3. Operations 




A, WI.C will operate the PROGRAM in the two Centers according to 
these terms and standards: 

(1) The PROGRAM will be ready to enroll students not later than 
4 September 1970, The Centers will be open and the PROGRAM 
will bo available for students for no fewer than 6 hours a 
day, 5 days each week during the school year. Additional 
hours of operation at any time, and reduced or adjusted hours 
of operation during school holiday or vacation poriods will bo 
arranged by agreement between WLiC and the SCHOOL, 

(2) WLC will accept for enrollment in the PROGRAM all students 
assigned to it by the SCHOOL, Based on test information 
provided for each student by the SCHOOL, WLC will establish 

a learning objective and a program of study for each student. 
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Each student’s schedule oi; attendance at the Center will be 
arranged as far as possible so that he may be expected to 
accomplish his objective on schedule, 

(3) VjLC may notify the SCHOOL within the first 20 hours of any 
Student’s attendance at the Learning Center that in its 
judgment the student cannot benefit from the PR0GR^\Mi and 
in such case 5 the student %7ill be withdravm from the PRO- 
GRAM, WLC expects that not Tuore than 5;4 of the students 
will fall In this category. Any student who is withdrawn 
from the PROGRAM may be re-enrolled after the factors re- 
sponsible for his withdrawal have been remedied, 

(4) Tlie results of the PROGRAM will be measured by the achieve- 
ment of students enrolled in it, llie unit of achievement 
is one achievement-year , which is equal to a 1,0 gain in 
grade level as determined by standardized tests, VJLC’s 
perforniance goal, tdiich is subject Lo the enrollment and 
attendance standards established In paragraph 3B(2) below 
is that student enrolled In the PROGRAM will accomplish 

a total of 960 achievement years. 

(5) WLC will arrange, in cooperation with the SCHOOL for 
visitors^ observers, orientation sessions, teachers work- 
shops, and other activities relating to the operation of 
the PROGR/^1 provided only that such activities are judged 
not to interfere with Its cffcctivo operatJon. 

A 

(6) WLC will arrange with the SCHOOL to piovide it v;tth appro- 
priate information on the progress of cnch stuclent enrolled 
in the PROGRAM, 

B, To assist v 7 ith and support the operntJon of the t!ie SCilOOI. 

will do these things ’ 

(1) The SCHOOL will select students for cnrolltnent in the PROGRi^I 
based on their needs for Instructioii in mathematics and reading. 
Each student enrolled will have an objectlvu of achieving not 
less than 1,0 achievement-years in one dr both subjects. Students 
enrolled for mathematics only will be at or above their grade 
level in reading. 

(2 The SCHOOL will pre-test each student assigned to the PROGMM in 
math and/or reading to establish his entry level. Only nationally 
standardized tests which report In grade level equivalents will be 
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used for pre-CGstiing, The SCHOOL will administer post^tests Co 
each student within five school days of being notified by WLC that 
the atudent has completed his work, ITie post-tests will bo alter- 
nate forras of the pre-testSj and the results of the pre- and post*- 
tests will be compared to determine a student *s progress in a 
subject measured in achievement-years. 

(3) Tlic SCHOOL will be responsible for the enrollment and attendance 

of students in the PROGRAM at standard levels v^hich will reasonably 
permit them to accomplish the PROGll/uM-s perforinance ioal of 960 
achievement-years. To this endj the SCHOOL willi 

(a) Enroll students for a tot:al of not less than 480 achleveinent- 
years in each Learning Center 3 or a minimum of 960 achieve* 
ment-years in both CctntcrSj and 

(b) Arraiige a *-staudard miniinuiii attendance” in each Learning 



Canter of at least 40 students (80% o£ the capacity of a 
Center) during each of the six hours of its operation on 
not less than 175 school days during the School year. This 
means that the "standard minimum attendance" In each Center 
will be 240 student-hours per day^ and that the "standard 
minimum school year" will be 175 days. 



A, The SCHOOL will pay WLG for its success in accomplishing the par- 

formance goals of the PROGRAM^ and for the achievements of the students 
enrolled in it, accordlni to the following terms and conditions: 



(1) The price for an achievement-year is $ 149,503 and the SCHOOL 
will pay WLG that price for each achievement-year accomplished 
by students enrolled in the PR0GRi\M, If students accomplish 
the PROGRAM goal of 960 achlovemcnt-years j then the SCHOOL 
will pay WLC $143,700. 

(2) If any student falls to accomplish at least a 1,0 achievement- 
year In a subject in 120 hours, tlie SCHOOL will pay nothing 

to WLC for that student's v?ork in that subject, and the price 
of that 1*0 achievcmcnt-ycar will be subtracted from the 
total amount to be paid to WLC by the SCHOOL, 

(3) If a student is enrolled with the objective of accomplishing 
more than a 1*0 achlovemcnt=year in a subject, his actual 
achievement, measured to the nearest 10 th of an achievement- 
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year, will bo creditod to the FROGRAH^ and the equivalent 
fraction of the price for an achlevomont-yoar will be paid to 
WLC, However 3 the SCHOOL will in no case pay for more achlevament 
than was established as the student objeetive when he 
enrolled. All achievement beyond 1:hat objective by any 
student will be at no cost to the SCHOOL. 

(4) Wlien the SCilOOL has enrolled students for a total of 960 
achievement-years, it may elect to enroll no more students, 
in which case it will owe no further payment to WLC, If the 
SCHOOL elects to enroll students in the PROGRAM for mora than 
a total of 960 achieveiiient-years , WLC will accept them for 
enrollment provided only that there is roasonabl. time for them 
to accomplish the objective for which they are enrolled. The 
SCHOOL will pay TOC for all such ac litional enrollments to be 
completed through August 31, 1971 at the rate of $75 per 
achievement •year , 

(5) If the attendance at either Learning Center on any of the 175 
days in the -'standard minimum year" is less than the "standard 
miniinum attendance" of 240 student^hours per day, then the number 
of student-hoiTrs by vdiich the attendance Is loss than 240 shall be 
considered excessive absence. The total number of hours of 
eKcesslve absences during the year, divided by the actual average 
number of hours in vdiich all students enrolled in the PROGRAM 
accomplish a 1,0 achievement-year , will be counted as achievement- 
years coniplcted , and the price for that number of achievement • 
years will be payable to TOC. Any hours of attendance by a 

’ student that total less than 50 in a subject, and all hours of 

attendance by a student for which no pre-test/post-test measure^ 
ments are available will be considered hours of eHcesslve absence 
for the purposes of this paragraph, WI.C will cooperate with the 
SCHOOL In scheduling additional hours of operation of the Learning 
Centers to permit students to make up excessive absences and in 
this way to minimize f he effects of this paragraph, 

( 6 ) The SCHOOL will make tnonthly partial progress payments to WLC 
on terms to be arranged, 

5. It is understood that either TOC or the SCHOOL will not be liable for loss, 
damage, detention, or delay resulting from causes beyond their reasonable control. 

6 * WLC will uae its best efforts to perform this AgreGment in a reasonably 
diligent manner. Tlicre arc no warrantlGS, express or implied, except as set 
forth In this Agreement; aiid the results of the Learning Center system are 
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guarantoad specif icnlly ns described 
no event shall WLC be liable for any 
arising out of this Agreement or the 

7* This Agreement Is not assignable 
written consent of the other party* 



hei^cin and in no other way# In 
consequeniial or incidential damage 
breach thereof, 

by either party without the prior 



a. All notices given in connection with this Agreement shall be given 
in writing. If to WLC 3 addressed to Westinghouse Learning Corporation j 
100 Park Avenuej New York, New York 10017^ attantlon: H, K, SkealSj Vice 

President, and if to SCHOOL, addressed to Superintendent, Grand Rapids 
Public Schools, 143 Bostwick, Northeast, Grand P^apids, Michigan 49502# 



IN WITNESS WHEREOF the parties have hereunto set their hands on the date 
first above written. 



GRAND RAPIDS PUBLIC SCHOOLS WESTlNGnOUSE LEARNING CORPORATION 

By I By I 



Appendix E 



GRADE SCORES AND GRADE EQUIVALENT SCORES 



The CMES contract specifies that growth will be measured by "Grade Score 
Increase." The EDS grade score (a so-called "standardized" score) resembleSj but is 
not generally the same as, the grade equivalent; in fact, the two are the same only 
for students who score exactly at their grade placement level (e.g., a sixth-grader in 
the second month of the school year who scores 6.2). 

On the one hand, grade equivalents equate test results with expected median 
scores of appropriate grade placement groups: for example, a student who receives 
a grade equivalent of 4.5 has scored at the expected median of students (from the 
norming group) who are in the middle of their fourth year. On the other hand, the 
Grade Score scale is designed so that only the median score of the norming group 
corresponds to grade placement; the other scores are designed to conform to a 
normal distribution with a standard deviation of 1.0. 

. Pre-test grade scores are plotted against reading raw scores in Fig. 9. Since the 
Grade Score is a standardized scale based on grade placement, there is a separate 
curve for each grade. By drawing a curve through the norm medians of each grade 
(that is, the points that correspond with grade placement* 6.2, 7.2, 8.2, and 9.2, 
respectively), the conventionai grade equivalent scale is implicitly obtained; this is 
curve (I) in the figure. Curve (I) has been extrapolated downward to cover the region 
in which most of the South Middle students scored. 






|- 
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Fig. 9— Grade Scores vs, raw scores, and derivation of 
implied grade equivalent scale 



In Fig. 10, this implicit grade equivalent scale is compared with the grade 
equivalent scale based on the medians of published norms for grades 4.6, 6.5, and 
6.5 (curve II). The differpnce between curves (I) and (II) represents a difference 
between norming groups. STS publishes ''national” norms for the grades for which 
the test was designed (grades 4, 6, and 6). The South Middle scores, however, are 
based on "core city” norms developed fi’om a sample of students in Detroit. For 
comparison, median scores for the South Middle pre-test are indicated by curve (III). 

All this suggests two issues concerning the use of normed scores for contract 
payment. First, the same test may measure growth differently when different norm- 
ing groups are used. In Fig. 9, for example, the implied core-city grade-equivalent 
scale is steeper than the national scale within the 36 to 60 raw score range* payment 
per raw score increase for students who score gains within this range will be some- 
what higher using core-city norms than would be the case with the national norms. 

The other question is whether the use of Grade Scores rather than grade equiva- 
lents has an effect on contract payment. The answer seems to be yes; but for any 
particular student, the effect may be either positive or negative, depending on (1) the 
amount of raw score gain and (2) the relative curvatures of the Grade Score scale 
and the grade equivalent scale. Consider three students (A, B, and C) testing at the 
beginning of their seventh and eighth years. Suppose their performance on the first 
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Fig. 10— Regular norms vs. implied "core-city” norms 
(EDS elementary reading pre-test) 



test is identical (raw score = 40) but their raw scores on the second test are 43, 46, 
and 60 (i.e., their respective raw score gains were 3, 6, and 10). Figure 11, which is 
an enlargem.ent of a portion of Fig. 9, indicates that their beginning score was 7.0 
in Grade Score (point O”) and 6.8 in grade equivalent (point O’). Student A gained 
1.0 in Grade Score (A”-0”), but only 0.7 in grade equivalent (A’-O’); Student B gained 
1.2 in Grade Score (B”-0”) and 1.4 in grade equivalent (B’-O’); Student C gained 1.8 
in Grade Score (C”-0”) and 3.4 in grade equivalent (C’-O’). 

It appears that the Grade Score scale is the more conservative since it tends to 
reduce both the contractor’s risk of low payment and the district’s risk of high 
payment; compared with the grade equivalent scale, low gains are not so low and 
high gains are not so high. The break between "low” gains and "high” gains, how- 
ever, depends on the steepness of the grade equivalent scale relative to the Grade 
Score scales. In the case of South Middle School, where the pre-test raw scores for 
most students were between 16 and 30, it appears that grade increases between 1.0 
and 1.6 will be roughly the same in both Grade Score and grade equivalent (assum- 
ing the extrapolated grade equivalent scale in Fig. 9 is correct), and that gains 
outside this range will be subject to the dampening effect of the Grade Score scale. 
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Appendix P 

MATERIALS LIST FOR GMES CONTRACT LEARNING 



READING MATERIALS LIST / -u 

Science Research Aaaoclates .> 259 Ei Erie St. > : Chicago 111. 60611 



1 Spelling Lab Ila ! ■ . 69,50 

1 Pilot Lab 11a 63,95 

1 . Reading Lab 11a & lie ,, 132.00 

1 RPU - Junior Edition ■ ' 4ii95 

1 Dimensions in Reading, " Me rl can Album" 60.00 

1 Dlinensions in Roading, "We are ’Black" 60.00 



£glt I or n i ■" Tes t Bu re .lu . .206 Bridge St,, New Cumberland, Penn. 17070 

Lessons in Self-Instruction on Basic Skills 
5 0 1.00 Reading iriteipretatidns i, A“B '5,00 

5 0 1,00 Reading Interpretations 1, C-D 5,00 

5 0 3,00 , Reading Inteirprqtatlons II,, AfB 5.Q0 

5 0 1,00 Reading lnte:cpi'otatldns IT, C-D 

Ol ROi<t Services. Inc. /Educ. Dlv . . Pleasantvllle, N.Y, 10570 
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rs (Rev# Editions) 
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5.60 
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Barnell L Qft g Rockville Centari New Yorkj N, Y. 



1 en 0 1,00 Getting the Facts ^ Bka, A* B* G| D* E 5.00 

I aa 0 1,00 Using the Contexts Bks. Aj B, Cg 0* E 5,00 

1 ea @ 1.00 Locating the Answer^ Bks. A| Bg G* D, E, F 6,00 

1 ca 0 1,00 Working with Sounds, Bks. A, B, C, D 4,00 

1 ea § 1.00 Following Instructions, Bks, A,B,C,D,E,F 6.00 

1 ea 0 1,00 Getting the Main Idea, Bk, A 1,00 

1 oa 0 1,00 Drawing Conclusions, Bk, A 1,00 

1 student answer sheet and 1 answer key for 
each book 0 5^ each 2 . 80 

Houghton Mifflin , 1900 S. Batavia, Chicago, ill, 

I Spelling Key Lab 39.00 

Beeklev Cardy . 1900 N. Narragansett Ave. , Chicago, III. 

5 0,56 Dolch - Puzzle Book I 2,30 

5 0.56 Dolch “ Puzzle Book II 2,80 



Encyaiopedia Britannlea , 425 N. Michigan Ave., Chicago, 111. 

1 Literature Satnpler (120 stories) 45.00 



Lyons & Carnahan , 407 East 25th St, , Chicago, 111, 
1 ea 0 45,00 Spelling Oaraes A, B, C, D, E 



225,00 



Field EntprprlseB , 609 Mission St,, San Francisco, California 
Checkered Flag Series 

1 A- V Kit A (Fllmatrlp, record, tape, book) 76.80 

1 A - V Kit B (Flltiatrlp, re cordj tape, book) 76# 80 



1 Cyclo Teacher, all cycles 

5 (I 75 Cyclo Machines 



49.95 

63,75 



Mo r r 1 11 P ub 1 1 s h 1 ng Co , , 1300 Alvim Crocik Dr. , Columbns , Ohio 43216 

1 Mainstream Cn^ *tte Librar'/ 228.00 



Visualcraf t ^ 12842 S. Western Ave- ^ Blue Island, 111, 

Hoff man Eticora Library' 

1 set ea @ 19.95 100-3, 101-3, 102-3 59,85 

1 set ea @ 19,95 100-4, 102-4, 102-4 59,85 

1 set ea @ 19.95 100-5, 101-5, 102-5 59.85 

1 set ea @ 19.95 100“6, 101-6, 102-6 59.85 



Bawmar Records . Inc. 



622 Rodiar Drive, 



Glendale* Call fomla 



Bowmar Reading Incentive Program (Cassette) 
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HIGH INTEREST— LOW READABT.LITY MTERIALS 



Benafle Press . 10.300 W. Hoosevelt Rd, , Westchester , 111. 60153 



1 


Dan Frontier Series Sight-Sound Sets 

Dan Frontier S? the nev^ house 


22.95 


1 


Dan Frontier k the big cat 


14.70 


1 


Dan Frontier goes hunting 


14.70 


1 


Dan Frontier , trapper 


15.45 


1 


Dan Frontier 6r the Indirai 


15,45 
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Dan Frontier Er the wagon train 


21.15 


1 


Dan Frontier seouts with the Army 


21.15 
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Dan Frontleri sheriff 


21.15 


1 


Dan Frontier ioas exploring 


• 21.15 


1 


Dan Frontier goes to Congress 


21.90 


1 


Sailor Jack Series 

Sailor Jack and Homer Pots 


1.65 


1 


Sailor Jack and Eddy 


1.65 


1 


Sailor Jack 


1.65 


1 


Sailor Jack and Bluebell's dive 


1.80 


1 


Sailor Jack and Bluebell 


1.80 


1 


Sailor Jack md the jet plane 


1.80 


1 


Sal 3 or Jack and the tiall game ^ 


1.80 


1 


Sailor Jack's new friend 


1.80 


1 


Sailor Jack and the target ship 


1.95 


1 


Sailor Jack goes north 


1,95 


1 


Teacher's guide for the aeries 


*75 


1 


Sport %stery Series 

Complete set of 4 titles ^ 


; 7.20 


1 


Ifystery Adventure Serlei 4* 

Mystery of the talking statues 


1.95 


1 


Mystery of the Jeweled bell 


1.95 


1 


Ffygtery of cave four ' ' ' 


1.95 


1 


Mystery adventure reader- I ■ 


3.93 


1 


Activity text reader 1 


.45 


1 


Teachers’ edition - act. text 


.45 


1 


%ster of the Indian burial growid 


1.95 


1 


^stery at Longcllff Inn 


1.95 


1 


Ftysteity of the smuggled treasure 


1.95 


1 


%ste^ adventure rtader II 


1.93 


1 


Activity text reader II 
Teacher's edition - act. text 


.45 


1 


.45 






World of Adventure Series 



1 


Coi^leta set of 8 titles 


14.40 


1 


Teacher’s guide for aeries 


.90 


1 


Student’s activity book for series 


.65 


McCorinl ck“ Mathers 


Publlahin^ Companyi 300 Pike St.? 


Cincinnati , Ohio 



The Challenge REader Series 

1 Level 1 2,16 
1 Level 2 2,31 
1 Level 3 2,40 
1 Level 4 2,61 
A Level 5 2.70 
1 Level 6 2.70 



tlA RDWARE READING MATERIALS 

Educational Pro^resa Corporatton ^ 8538 East 41st St. , Tulsa? Okla, 



Audio Reading Pfogifeso Laboratory 
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Grade 1, 


Reading progress book. 


#1-115 


3.75 
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Grade 2, 


Raadiug progreg'd book. 


#1-125 


3.75 




5 


0 .75 


Grade 3, 


Rending progress book. 


#1-135 


3.75 


r = 


1 




Grades 4- 


■6, Corapletd Program, 


Gassetta 












#1-1423 




252.00 


f: 


5 


0 .65 


Grado, 4, 


Reading' progress book, 


#1-145 


3.25 




5 


0 .65 


Grade 5, 


Reading progress bookk 


#1-155 


3.25 




5 


0 .65 


Grade 6, 


Reading progress book. 


#1-165 


3.25 



I ■ : ■ ■ ■ . • ' . . - - ■ ^ , 



Bor^^-Warher Edycation Eystem Sj 7450 N, Natchez ? ^ChicagOj 111. 



I 

f?5- 



10 

1 

1 



System 80 Machines S' 495.00 

Learning letter names & sounds; 

Kits AB . 

Kits CD 

Reading: words In context , ■ ■ : 

: Kits ABnDEFGH', •' 

> Deve loping spelling skills 

Kits ABCDEFG 



4,950.00 

225.00 

225.00 

1,000.00 
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1 



787.50 



Viaii.' I cia rt , Inc. , 12842 So. Western Ave. , Blue Island, 111. 60406 



25 Hoffman Reader Machines @ 389.00 

1 ea @ 99,00 Prl iiary Achievement Units - 100-0 



101 - 0 , 

105-0 

1 ea 0110,00 1st Level 
101 - 1 , 
105-1 



102-0, 103-0, 104-0, 

Achievement Units - 100-1 , 
102-1, 103-1, 104-1, 



1 ea @110.00 



2nd Level Achievement Units - 100-2, 

101-2 i, 102-2, 103-2, 104-2, 

105-2 (when available) 



1 ea @125.00 



3rd Level Achievement Units - 100-3, 
101-3, 102-3 



1 ea @125.00 



4th Level 
101-4, 



Achievement Units 
102-4 



100-4 , 



Hoffman Reader 
1 ea @125.00 5th Level 
101-5, 



Achievement Units - 100-5, 

102-5 



1 ea @125.00 



6th Level Achievement Units - 100-6, 

101-6, 102-6 



595.00 



660.00 



660, 00 



375.00 



375.00 



375.00 



375.00 



1 Guide book for 100-0 - 105-0 2.95 
1 Guide book for 100-3, 101-3, 102-3 2.95 
1 Guide book for 100-4, 5, 6 | 101-4,5,6 1.50 
1 Guide book for 102-4,5,6 2,95 



1 each Primary Achievement Work Sheets 



100- 00-WS through 100-09-WS 3,50 

101- 00-WS through 101-09-WS 3.50 

102- 00-WS through 102-09-MS 3.50 

103- 00-WS through 103-09-WS 3,50 

104- 00-WS through 104-09-WS 3.50 

105- 00-MS through 105-09-WS 3.50 



1 each lat Level Achievement Work Sheets 

100- 1-WS THROUGH 100-09-MS 3.50 

101- l-W.S through lOi-09-WS 3.50 



104 



102“.i-WS fhroiioh 102-09-WS a. SO 

103- 1- WS through 103-09- WS 3,50 

104- 1-W." through 104-09-WS 3,50 

105- 1-WS through 105-09-MS 3.50 

1 es''h 2nd Level Achiovement Work Sheets 

100- 2-WS through 100-09^MS 3.50 

101- 2-MS through 103-09-WS 3.50 

102- 2-MS through 102-09-WS 3.50 

103- 2-WS through 103-09-MS 3.50 

104- 2-WS through 104-09-MS 3.50 

105- 2-MS through 105-09-WS 3.50 

5 each 3rd Level Achievemi nt Work Sheets 

100- 3-AB 1.75 

101- 3- AB 1.75 

102- 3-AR 1.75 

5 each 4th Level Achlevament Work SheBts 

100- 4-Ali 1.75 

101- 4-Ar! 1.75 

302-4-AR 1.75 

5 each Sth Level Achievement Work Sheets 

100- 5-AB 1.75 

101- 5-AB 1.75 

102- 5-AB 1,75 

5 each 6th Leve] AchlovernGnt Work Sheets 

100- 6-AB 

101- 6-AB 1.75 

102- 6-AB 1.75 



Fred Edc l sto n Compa ny , 2910 West Petorsun Are., Ohleago, 111. 60645 

50 @ 22.50 Alwn TKpe Cassette Recorder 

Model’ TP-739 1,125.00 

50 e 2.50 AC - 607 Convertors 125.00 

Mid west Vi sual Equipment Comnany , 6500 N, Hamlin, Chicago, 111, 60645 

ATC 300 A Record Players 127.90 



106 



2 0 63.95 



60621 



Selected Sound S Prod ucts p Inc * 3 2733 Central bt* j Evanston^ I'l. 

50 g 7.95 Electric-fane ^978 (mini-plug) 397.50 

25 0 7*95 ElecLri c- foue #976 (staiidard plug) 198,75 



MA THEM ATICS MATERIALS LIST 



Char lea E* Merrill Publisher , 1300 Aluin Greek Drives Columbus, Ohio 43216 

2 @ 275*00 Hathematlcs Skill Tapes #7309 $ 550.00 

12 0 25.00 Mathematics Replacement 

Package #7310- 300*00 



Midwest Visual Equipment Co * ^ 6500 N* Hamlin, Clilcago, 111* 60645 

1 Intermediate Imperial Cassette 

Maths Program #1M456C 339*00 

4 ea @1,95 ^upll ReBponse Books 

Lessons 1 to 20 156, 00 



soration, 



41st St. 



TulBa, Okie* 74145 



1 

1 



Continuous Progress Laboratorv 
Series 300 #2-032 

Series 400 #2-042 



106.50 

106.50 



Serlae 500 fl2~052 

Series COO #2-062 



106.50 

106.50 



200 i ,55 



Student Progress Books 



110.00 



Snlence Research Assoclatas . 259 E. Erie St. , Chicago, 111. 60611 



1 Arithmetic Fact Kit #3-520 51.85 

50 0 ,45 Student Record Books #3-539 22,50 

5|2l.‘73' Pacer #3-416 108.75 

1 Cr0SS”Number Puzzle Box #3-3780 26,95 

50'@ ,48*:.. Studdnt Record Books #3-3781 . 24,00 . 

1 Cross Number Story Problems #3-4160 . 26,95 ... 

50 9 ,48 Studerit Record Books #3-4181 24,00 



California Test Bureau* 206 Bridge 


St. * 


Hew Cumberland* 


Penn. 


17Q70 


5 @ 1.00 Self-Instruction 


Addition 


A-B 


5.00 




5 0 1.00 Self-Instruction 


Addition 


C 


5.00 




5 0 1.00 Self-Instruction 


Addition 


D 


5.00 





I 

I 

I 

F 



I 

t 

p 

I 

o 

ERIC 

hiMfiiifftBfTiaaaa 



Electronic Futures* Inc. 
917 S. York Rd. 
Elmhurst * 111# 60126 



Elementary School Hathcmatlcs 

G-lOpl Level A $ 63,80 

CilQDOB Level B 127.20 

set of 16 inlni systems 111, 99 31*84 

_C-1OO0C Level C ' 

sets each of 16 mini systems @$1,99 63.68 

C-IO OOD Level D 127,20 

sets each of 16 mini systems @$1,99 95=52 

^ilOOOE Level E 119.25 

sets each of 15 mini systems @$1,99 89.55 

C-IOOOF Level F 111.30 

sets each of 14 mini systems @$1.99 83,58 

_£-1000G Level G 119,25 

sets each of 15 mini systems @11,99 89,55 



* 

921 01-01 Itodel lOlAC Audio Flashcard 

; , Reader @$250.00 V, 

€2SOQilOO Self Instruction Basic Mathmetlc Level I 

22504-00 Self Instruction Basic Hathmatic Level II 

-50325-60 Stud^t Workbook I^vel II ^ . 



$3-750.00 

158.00 

275.00 
63.00 > 
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22506-00 Self Instriictlon Sc^idEn®- WeYfchTDok Level III 
50456-00 Etudent. Workbooks Level III 
22507-00 Self Instruction Studant Workbook Level IV 
50457-00 Student Workbooks Level IV 
^2508-00 Self In.structlon Student Workbooks Level V 



164.00 

63.00 



166.00 



63.00 

263.00 



1,185.00 



5 


0 


1. oo 


Self-Instruction 


Subtraction A-B 


5.00 


5 


0 


1.00 


Self-Instruction 


Subtraction C. 


5.00 


5 


0 


1.00 


Self-Instruction 


Subtraction D 


S.OO 


5 


0 


1.00 


Self-Instruction 


Multiplication A-B 


5.00 


5 


0 


1.00 


Self-Instruction 


Multiplication C 


5.00 


5 


0 


1.00 


Self-Instruction 


Multiplication D 


5.00 


5 


0 


1.00 


Self-Instruction 


Division A-B 


5,00 


5 


0 


1.00 


Self-Instruction 


Division C 


5.00 


5 


0 


1.00 


Self-Ins t .ction 


Division D 


5.00 



Charles E. Merrill, 



1300 Alum Creek Dr. 



Columbus, Ohio 






5 @ 10.50 Graded Difficulty Cards #2150 



52.50 



HouRhton-M.lfflln Co . , 1900 S. Batavia Ava. , Geneva, 111. 60134 



1 



Concept and Skill Cards #1-14704 41.25 



VlBualeraft. Inc . 12842 S. Western Avc. , Blue Islmd, 111. 60406 



1 Math Tabletainer 19.95 

1 Math Fractlonflnder 19,93 



Hareourt-Brace & World Inc, 



7555 Caldwell Ave, 



Chicago, 111. 



60648 



100 @ .99 Learning to Confute Book 1 

25 0 5 99 Leanilng to Compute Book 2 



99,00 

24.75 
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Wabster-McGraw^Hlll i Manchester * Missouri 63011 



2 @ 4.20 Tangrams (cards) #17445 8.40 
2 @ 2,40 Tangrams (pieces) #17446 4,80 
1 Tangrans (t,g) 1,50 

La Pina Sclentlflc » 6001 S, ^xok Ave. ^ Chicago^ 111. 60629 



2 @ 5.00 Place Value Hoard 



10,00 



Seleetlve Education Equipment , 3 Bridge St., Hewtonj Mass, 



1 



CalculatDr #001 



10 for 13.00 



Creat ive Publ i cations » P,0. Box 321, Palo Alto, California 94302 



36 palrB 
4 @ . 75 
1 

2 I 1.50 

2 @ ft. 00 

1 

I 



Dice #MI.M-8A 
Playing cards #MLM-6 
Aftermatn lA - 4B #M1P-18 
Dondnoes #MLM-18 
Multlfact.or #MLM-2 
Design Posters //MCS-7 
Puzzle I'osters ?/MCP-13 



4.00 

3.00 
45.00 

3.00 

8.00 
3.50 
5i00 



Mili'ib Klfiiball Co . , 41 W, Eighth Ave, , Oshkosh, Wis, 54901 



2 P 2.29 Yaht zee #4180 



4.58 



Educ a tion Systems , 7450 N, 

3 L'uarnlng Numbar Facts 



Natchez, Chicago, 111, 
, Kits A,B,C,D 575.00 



60604 
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Appendix G 

THE CMES-GRS CONTRACT AND 
EXCERPtS FROM THE GRS-MODEL CITIES CONTRACT 





This Agreement made this ___ day of September^ 1970^ between the Boar! 
of Edueatioa of Grand Rapids ^ Miehlgan, hereinafter referred to as the Diatrietj 
and Combined Motivation Edueation Systems * Inc,p hereinaftar referred to as 
the Gompai^^ 

TOFREAS, the Biatriet l^as been duly empowered to enter into this contraat 
with the Company to provide reading and math Improvement programs at the South 
Middle School, the school year comraencing on the 26th day of August, 1970 and 
terminating on the 11th day of June, 1971 • and 

WHJSREAS, the District is presently controlling and operating the South 
Middle School and la able to, and shall, furnish sufficient space within such 
school Including aljL utilities, maintenance and janitorial services for the 
conduct of claoses and other instructional services Co be conducted by the 
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Coapany as provided herein^ 

NOW, THEREFORE, in consideration of the several agreetjants herein 
containad, the District and the Company harehy agtee as follows: 

1. TEACHERS 

A, The District shall provide a Program Director, four (4) quali: *cd 
teachers and ton fiara—profasslonals who shall ha assigned to the 
Combined Motivation Educacion Program. 

1, The District shall have the responsibility for payment of all 
normal fringe benefits as well as the issue of salary chaoks. 
Said, teachers and para-professionals; are not n w, nor will they 
be, loaned or borrowed employees but, in all ro^pects, shall 

be employees of the District, and nothing contai.ied herein shall 
be construed so as to make said teachers or para-professionals 
"loaned" or "borrowed" employeep the Company. Costs 
incurred by the District will be aeducted from the. payment to 
the Company as indicated in V,A. 

2, If, at any time during the term of this contract, any or all 
of the teachers and/or para-prof asslonals supplied by the 
District shall request, or be requested by the Company or the 
District, to discontinue their services under this Agreement, 
the District,' shall amacdlataly supp].y the Company with a 
replacement for such teacher(s) or para-professional (s). 

3, In the event the Disttrict shall dosira- the removal of a teacher, 

: Program Manager, or para-professional froni the Company's, 

program, it shall first consult with the Company, . 

. - , j... , . . - , . ^ 

B. The Company shall provide all necessary instructional material 
and assi.stance for and in the conduct of its Combined Motivation 
Education Prograra, hereinafter referred, to as CMEP, for the 
improvement' of reading and nathematlcai levels of students placed 
in said prograBL at the South Middle. School;- 

II, STUDENT 'SELECTION, ., ,The District shall select a sufficient number . of 
students to provide' the \equlvalent of 1200 student units* who shall 
be placed in the ;.to be conducted by the Company, ■ 



* One student unit equals pne student enrolled in one subject for one class 
perlbd each day for one school year. 




A, Students shall be initially selected for this program by the 
District on the basis of a mutually agreed upon Standardized 
Achievement Test, 

1, Those students selected on this basis shall be the ones 
performing at the lowest level on that test, so that the total 
number of students shall comprise all those students at the 
lowest level. 

B, The Company, within the first 30 calendar days after asslgrment 
to the CMEP, shall have the r.'.ght on the basis of emotional or 
mental reasons unrelated to tne standardized test results to refuse 
up to, and including, ten per cent (10%) of the students selected 
and, in the event this right is exercised, the District shall 
select replacements from the remaining students, excluding those 

so refused within five (S) school days of the date of the refusal, 

!• The District shall have the right to reject the Company's 
refusal to accept such students up to one-half (1/2) of the 
above ten per cent (10%). In this event, the Company shall be 
paid for such students on the basis of the mean gain of CMEP 
students exclusive of those students refused by the Gompany 
and rejected by the District, 

2, Ko payment will be made for rejected students, 

C, In special cases, a student may be dropped or added to the CMEP 
upon mutual agreement of the Pri icipal and the Program Director, 

III. FACILITIES . Tlie District shall provide the equipment and facilities 
as sat out as start-up costs in Appendixes A and 3 the Proposal 
dated July, 1970, at South Middle School during the term of this 
Agreement as its sole cost ar^ expense, which equipment and facilities 
shall remain the property of the District. 

IV, PROGRAM . The Company shall conduct its reading and math remediation 
program known as the CMEP at the school site during tue term of the 
school year conmencing August 26, 1970 and terminating June 11, 1971, 

A, The Company shall train four (4) teachers, as supplied 
by the District under the provisions of Article 1, who 
shall be responsible for the conduct of teaching the 
program. Training shall be conducted at the school site 
beginning August 17, 1970 and ending August 28, 1970. 

8. ”he Company shall use its own methods and procedures of 
j.nstruotion in the conduct' of its CUES, 
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C. The Company shall evaluate and test all students in its 
classes at least once every thirty (30) school day period 
and shall maintain daily progress records on each indivi- 
dual student at company expense, all of which shall be 
made available to the oistri.cc upon request at the office 
of the Program Director, 

D. The Company shall provide theDistrict with cost effective 
ness information on the instructi.onal program, 

E. The Company shall assume all costs and responsibilities 
for the training of the CMEP management program. 

P. The Company shall establish with South Middle School a 
schedule and prograin of transition of the system to the 
District. 

G, The Company shall bear all direct operatior.-il costs of 
the program, including salar'es, consumable materials, 
publi relations, recordkeeping, reporting, manage.'nent 
and staff development. 

H. , The Company shall conduct nacessary programs to com:;, uni- 

cate the CMEP to the community, parents and school people 

SCHEDULE OF FEES 

A. The District shall pay the Company the sum of $6.00 per 
student for each one- tenth (1/io) of Grade Level Increase 
in each student's mathematical ability and $6.00 per stu- 
dent for each one- tenth (1/10) of Grade Level Increase 
for each student's reading ability, figured to the near- 
est tenth achieved by each of the students in the C.MEP, 
out, in no event shall said sum exceed $164,000.00 less 
salari : s paid teachers, para-professionals and Program 
Director, and fringe benefits paid to Program Director 
only, 

1, The base (or starting point) for the grade level 
of each of the students for mathematics and read- 
ing shall be determined by his individurl perfor- 
mance on the mutually agreed upon standardized 
test, administered at the conmencement of the 
school year, 

a. For the purposes of determining the true 
base level of those students who fail to 
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meet "chance level" (ii.e, frequency expec- 
tancy ^ number of distra ctionSj multiplied 
by the number of items on the test), those 
students will be retested at the next lower 
level -ccst and that shall be the student's 
base grade level , 

2, Grade Level Increase (Grade Score Increase) in 
mathematics and reading, shall be determined at 
the end of instruction at which time the mutually 
agreed upon standardized test shall be admini- 
stered, except for those students who initially 
failed to meet "chance level," and they shall be 
tested on the basis of the next lower level test. 

3’. If, after the grading of the test at the end of 

the instruction period, any amounts shall be payable 
to the Company as provided in A above, the total 
amount so determined shail be paid by the District 
to the Company within ten (10) days of the receipt 
of such computations from the Company . and certifi- 
cation by a mutually agreed upon third party evalua- 
tion specialist, less any amounts paid, by the Dis- 
. trict under Article I, but, in no, event shali such 
total amount exceed the sum of $164,000.00, 

4, In addition to all other payments, the District 
agrees to pay according to the following schedule, 
and. pursuant to the follov<ing conditions?. 

a. If the, District shall fail to supply students 
to the Company as set out in Article ,1I, the 
Di strict shali. pay an .amount equal to the pay- 

. ment based upon the mean Grade Level lncrea.se 
per day per student to,, be computed at the end 
of the 180 day period as set out in Article V, 
Section A, Paragraph 3 to the Company for each 
such student for every school day which the 
District failed to supply such student, not 
b including five ,schopl days allotte.d her to 

Vthe supply ing . of such student , 

b. if any Student fails ^ t^^ classes of 

CMEP for a total in excess of , ten . (10) days 
during the course of the 180 day school year, 
the Distrie.t shall pay the Company an amount 
sQual to one— half (1/2) of the mean rate pay— 
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ment based upon the mean Grade Level Increafie 
per day per student to be computed at the and 
of the 180 day period, as set out in Article 
V, Section A, Paragraph 3, for each such stu- 
dent per each day in excess of the ten (10) 
days which he failed to attend the classes, 

a. In no event shall the payments under this 
paragraph, when added to the paymonts under 
Section A of this Article, exceed $164,000.00. 

B. Administration of pro- and post-tests shall be the 
responsibility of the District; only the District, the 
Company or a mutually agreed third party shall test or 
supervise the giving of such tests. 

C. It is agreed that neither the District nor the Company 
will be liable for loss, damage, detention or delay, 
resulting from causes beyong their reasonable control. 

D. In the event tiis Agreement cannot be performed because 
of strikes, lockouts, acts of God or any other cause 
not the fault of the Company, the District shall pay 
to the Company the sums of sixty-sevein cents ($.67) 

per student unit per day for each day that the Company 
did perform under this Agr#,ement, 

IN WITNESS, WilEREOP, the parties have set their hands the day 
and year above written. 




GRAND RAPIDS PUBLIC SCHOOLS 



By; 



By; 
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COMBINED MOTIVATION EDUCATION 
SySTEMS, INC. 



f 

I 

f 



EXCERPTJ _FROM GRS-MODEL CITIES _ CONTRACT 



Secuion 2. Boovb of Services 

, n^\^octiveB * This Agraament is for »tha purpose of providing a rapid 
learning center at South Middle School with a curricula designed to 
eelf motivate low achieving students to improve reading and matli skills 
on an average of two grade levels. During the period of this Agree^ 
ment the project will have the objectives toi 

(1) Raise the level of 500 to 600 low achievement students an average 
of two grade levels in reading. 

(2) Raise the level of 500 to 600 low achievemeat students an average 
of two grade levels in mathematics. 

(3) Se lf--motivate low achievement students to accomplish these 

inereases. < 

( 4 ) Provide for effective citizen decision making power in the devel-- 
opment and evaluation cf education projects effecting Model 
Neighborhood residents. 

f 

B. Activities . This Agreiment mil provide for the following activities 
and servlcesi 

( 1 ) The Contractor will subcontract with Oombined Motivational Educa^ 
tidnal Systems I Inc.p hereinafter called CO^Sp to establish a 
self motivation rapid leading oen.^er at South Middle School. 

(a) COMB will instruct up to 6 OO low achievement students in reading 
and up to 6 OO low aahlevemant students in mathematics by meana 
of self motivatien curricula. 
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(3) The Contrantor will recruit, aelect and atudants to the 

rapid leading center, 

( 4 ) Student selection p participation and removal will he governed as 
follows I 

(a) Students will he selected in inverse order from achle%'e:nent 

i A ^ ^ 

y0S wb « 

(h) The participation of atudants must he with the consent of 
their parents. 

(c) Up to five per cent of the students so selected by the Con-- 

t ran tor may be re,iected by CONES on the basis of emotional 

or mental reasons unrelated to achtevement testj results 

i 

provided such re )cotiona are made within 30 calendar days 
after the first day of the program, 

(d) Thera must he at least 400 students enrolled in roading 
courses and at least 4 OO students enrolled in mathematics 
courses no later than 60 days after the first day of the 
program. Such enrollment shall he naintainad all times 
thereafter as a minimum perforfi^noe condition of this Agree- 
ment, 

(a) Students moving during the year within the City will remain 
enrolledp with the parent »s pemission, as full time students 
and will be trar sported by the Board of Education for che 
remainder of the school year along scheduled Board of Educa- 
tion bus lines, 

( 5 ) A parent educational demonstration meeting will he soheduled and 
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held at the heginning of the program, 

(fi) The Contrsoter will conduct at least two evaluation meetings with 
parenta^ one being at the end of the second semester, 

( 7 ) The, gont raotor ;/ill employ an independent evaluator for this 
projec t who will provide a tentative report by March, 1Q71 and 
a final report prior to Au^st 1, 1971# 

C* Special Conditions, This Agreement and its activities shall be con-- 
ducted by the Contraotor under the following special conditions s 

( 1 ) A gommunity Bduoation Council will bn created and funded by the 
Model Neighborhood. Gltisena Committee * Inc., hereinafter called 
MCCi The Ooimeil will bo composed of nine members as follows 1 

(a) One person appointed by the M^or of Grand Rapids from a 
list submitted by the MGC, 

(b) Two Board of Education staff persons appointad by the Board 
of Education who are involved in school program plarming and 
inner-city school administration# 

(c) Two Model Neighborhood high school students eleoted by their 
own peers# 

(d) Pour Model Neighborhood adult residents appointed by the MCC 

( 2 ) Proposed ourrloula ohangcSi ‘tentative reports ^ proposad contract 
aaendmants and similar policy qwistions concerning this project 
shall bo referred to the Ooimunity Education Council for review 
and recommendation prior to adoption by the Contraotor and the 
City# The Oommmity Education Counoll may appeal administrative 
deeislona on this project directly to the Board of Bduoation 1 to 
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thfl City or both, 

(3) The WCC will sporisor a training program for the Community Educa- 
tion Council membfiirs, 

(4) The Community Education Council will elect their officers and 
prepars by-laws. JfflCC will astablish tenure of office. 

(5) The powera of the Community Education Council will inc? 4 Udei 

(a) Program plarining involvafflent In all compensatory education 
programs eff acting Model Nelshborhood students. The Com- 
munity Education Council shall be involved from the outset 
of program developmant, 

(h) Required Model Cities sipi-off approval cf all applicable 

educational fiinding applications affecting WN students shall 
require the review and approval of the Oommunity Education 
Council. 

( 6 ) Nothing In this Ag~ jament shall be construed to violate the rights 
and responsibilities ^ven to the Board of Education by State 
Statute . 

(7) Pirst priority shall be given to Modal Neighborhood resldenta for 
all poBltion!/) of paraprofessional teacher aides used in this 
project, 

T). Budget . Coopenscttion for the aotlvlties ol thlB AgreeBient shall be as 

follows s 

(1) The City aUall reimburse the Contractor up to Sixty Thousand 
Dollars for expenses incurred as follows 1 
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(ft) Twenty Thotisand Pollara for start-up exponses incurred for 
equipmenl, furnishings and supplies peculiar to this projact 
upon City approval cf the V/ork Program required by Saotion E 
of thia Agreement* 

(b) Twanty Thousand Dollars for the salaries of teachers and 
paraprofessional teacher aides employod in tha project* 

(o) Ten Thousand Dollars upon verification that an avaraga Grade 
Level Inerea^se of one full year or more has been achieved 
by studanta in the project* 

(d) Up to $10p000 for raiiaburs ament of ©na-thlrd of tha paymants 
made by the Gontrsctor to COMES* Faymants ara fundi paid to 
corns in excess of project salary costa. Payments will be 
aada under this section only if at, least an average grade 
level Increase of one full year has been achieved* 




B. Wo ^rog »m. Within fiftean ( 15) days of the siting of this Agree-- 
mantj the Contractor will submit a Work Program for the approval of 
ODA. The Work Program will include 1 

(1) A Schedule of Events which lists all key project activities 
included in this Agreement and which shows the time period after 
execution of this Agreement during which each key project element 
was accomplished or is expected to be^n Md end* 

(2) An Implementatioa Sequence Diagram depicting the key project 
elements from the Schedule of Events* The diagram will show the 



flow of events and relationships of key project elements md 
other contract activities beginning with the si|^ng of this 
Agreement or earlier program implementation activities* The 
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Diagram will include all neceaaary^ steps required to implement 
all aotivities of this prodect, GDA will provide techiioal assist- 
tance in preparation of the Implementation Sequenoe Pi. ^ram * 

( 3 ) A Narrative Description of each key project element, wiich shall 
includet The purpose of the activity; a definition of what the 
activity is to oonaist of; the methods to he used in cj.rrying out 
the activity; and comments nn any coordinating actlviiiies neces« 
sary to the proper and timely implementation of the activities. 

F. HonitorjnfT Heuorts. ‘ The Contractor will collect informatics required 
by GDA for the propor monitoring and evaluation of this prejeet. 

( 1 ) I nformation w ill he submitted to GDA by the Contracto r in monthly 
Monitoring Reports, Monitoring sports wi ll be provi ded b ^ 
within 10 v/orking days of contract. All information listed on 
the Monitoring Rsports will ba roquirad as part of this Agreement , 
GDA may, from time to time, add to or reduce the infonnation 
required# Oontraotor my, with GDA approval, add, change or 
reduce items of inicpraiation as appropriate to final methods of 
project implementation , 

(i) The Contractor will subB^t a copy of the approved Schedule of 

Events with the Monitoring Reports monthly# The Oontraetor will 
indicate thereon actual time of work on each key element during 
the reporting period in order to provide a visual compaiison 
between ari^nal faraoasting and actual implementation. 



Appendix H 

THE OEO RFP AND I’HE GRS-ALPHA CONTRACT 



PEnFORMANCR tNCENTIVE REMEDIAL EDUCATION EXPERIMENT 



The Office of Economtc Opportunity is planning to carry out a major 
field OKparlment In remedial educntion techniques. Qualified companlGs in 
the field of applied odi'catlonal technology are Invited to submit proposals 
In response to the questions and Issues stated beloM, 

The purpose of the experinient is to determine the effectiveness of a 
range of instructional techniques for remediating dlsadvartaged school child- 
ren In the subject areas of reading and math. OrganlaatjLons In the field of 
applied educational technology have developed various approaches and in- 
Btruetlonal teclmlques. The Office of Economic Opportunity intends to compare 
different approaches and techniques in teaching reeding and mathematics to 
disadvantaged scbool children in order to determine the effectiveness of each 
of these approaches. Offerors should propose a technique or approach which 
ttiey feel is best suited for this experiment. The Government may select up 
to six techniques to use- as comparisons In the experiment. 

It should be noted carefully that this Request for Proposals will not 
result in any contracts between the Office of Economtc 'Opportunity and those 
companies submitting proposals In response to this request. 

However^ thc-Offlce of Economic Opportunity plans to mako grants to selected 
schools (approximately 24) throughout the country. Those schools will in 
turn subcontract with the selected companies in order to carry out remcdlai 
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educaUional prograins foi* children who are not perforralng up to grado level 
fitandards . 

In most cases j the contractB bctajoen the schools and the selected organi- 
sations will be of the performance incentive typo; that is, the companies 
will compare the effectiveness of some of the educational technlquas as 
carried out under a performance Incentive contracting arrangement with both 
the use of the techniques alone (l.e., without the performance Incentive), 
and with regular school programs. 

The experiment t#lll be conducted along the follovjing lines: The approxi- 

mately six organizations selected, having a domonstrated capability and exper- 
ionce in educational training and technology, will each carry out an instruc- 
tional program In several locations, (It Is currently contemplated that 
each organlBation will carry out programs in thron different schools, either 
within a single city or in three different cities ) and two sots of grades 
-- first through third and seventh through ninth, 

A limited number of the eMperiinental techniques (probably two) will be 
carried out under both a performnnee incentive contract arrnngenienu and under 
a stnndard rcimlnirsement ciintrnct. This will provide some indication of the 
extent to which any improvements achieved are due to the education technique 
employed, the motivating power of Incentives, or the two in combination. 

Ideally, it would be desirable to tost all the different treatment approaches 
in the oKperiment imder theno two conditions, but beeau«c of Lhc extrcuifily 
ihort lead time for mounting the experiment, this will not be possible. 

The experlincntnl instruction will be carried out for a full academic 
yt'jc. It is estimated that the amount of inctructlonal .•ictlvlty should be 
on rbe order of an hour each day per subject. 

An tndependerit evaluation will be made of the total experiment. It vjIII 
con.slst.of pro- and post- meoBures on standardlzod tect.s given to both the 
students in the experiifiental classes and control groups. Companies chosen 
to carry out the .cducntional part of the experiment will not bo _parmlttod to 
compete for the evaluation contract. 

The Office of Economic Opportunity, in cooperation with the approximately 
six selected organlKatlons, will select the school systems which meet the 
roquirements of the experiment. These schools should have a large disadvantagod 
and academtcally retarded population and they must be both interested In 
participating in the experiment and able to make the necessary organizational, 

curriculum, and schedule changes by. September 1970. As mentioned above, the 
Office of Economic Opportunity Intends to award grants to these seiected 
school systems, who will in turn enter into a contract with one of the six 
selected corapanlos. 
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In the solcctlon of the six organisations to comprise the exporitnenc, 
eonsiiieraUlon v;ill bo given only to those organlxations which have a ^ 
demoiistrated capability In educational tcchnitiues and technology appropriate 
for remedintlng disadvantaged children in reading and math. The prop sa .s 
must a^so contain plans for the teaching program to be. conducted upon a 
perforTtiance incentivo contracting basis. 



The purpose of this experiment is to evaluate the relative effectiveness 
of existing techniques, not to under^srit.e the development of new techniques. 
Moreover, to be considered, organizations must demonstrate their oapability 
to carry out an instructional program of the magnitude described above by 
SeptGmbGr 1970. 

The approximately six controcUors who will particlpats in this experiment 
will be selected upon the basis of their responses to the following questions: 



a) A statement of their general capability and a desertption of all 
corporate and staff experiences in the area of applied educational 
technology and training, 

b) A full description of their proposed approach, t.e. the particular 
raatcrials, procedures, types of hardware (if any) and software used, etc. 
and a discussion of previoiis findings using this appro.ich. 

c) A description of how they propose to supply instructional staff, 1*0.^ 
whelhoi* their own instructovn will bo supplied, v?hether they will Ltali'i 
existing teachers or other local people, etc, 

d) A desctiptlon of the incenti* e.'s, if any, which are part of their appro.'ich 
and whom they are mainly nlvu'd at (c.g., pupils, teachers, parents, 

the school system). 

ti, A dfscfiptlon of their approach to school/contracUor cooperation, 

Jncluding toachor'r. unton.s. This section should .also tncludn a daseription 
of anticipated pfoblems of program Implevientation and proposed r.olutloiit 
to these problems. 

in.addiuioii, the proposal should contatn a description of tho basts upon 
wliieh they propose to rceoive payment. This should describe the relaUtonshtp 
between grade level Increases to be achieved, length bf tima within which 
achievement of increase Is expected,, and a schedule. of payments graduated 
in accordanco with tho actual length of time required to achieve the grade 
level iherease. Due to the multitude of unknown variables at this stage 
(location of schools, local salaries, number of students, etc.) only, general 
opproxlmatlons of the above are expected: The proposal should discuss the 

various cost factors and assumptions which were considered in arriving at this 
estimate. 
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The proposal should state CIio axLont to vhich the tochniquas and 
niaterials to he used in this experiment are patented , copyrighted, or 
otheTOise Bi?bject to proprietory Interests. To the extent any of the 
materials and tachniquas are subject to the above interests i the proposal 
should set forth the terms upon which the Contractor Is prepared to license 
such techniques and materials. 

The proposal should ba addressed and mailed to the Office of Economic 
Opportunity, Procuremant Division, 1200 19th Street, N.W. Washlniton, D.C. 

20506. If hand-carried, your proposol should be delivered to the Procure- 
ment Division, Room,L522, 1111 18th Street, N. W., Wnshlngton, D. C. 

Proposals must set forth full, accurate, and complete litformation as 
required by this Request for Proposals. The panalty for making false state- 
ments in proposals ,1s prescribed in 18 U.S.C. 1001. 

The clo s ing date for rocolpt of proposnls Is 5;30 P,H., E.D.S.T., 

1 1 Ma y 19*/0. Proposals should be rnailed in .sufficient time to YeTach this 
office prior to 5-30 P.H. , E.lVTS.T. — — — — 

Wereelise that this dons not provide adequate time to prepare detailed 
proposals covering all the complex *'1 e sues ralating to this eKperitr.ont. Hovj- 
ever, because of the large number of tasHs which must bo accomplished in tlie 
coiiilng months and the nocessity of launching the eMperiiriant by September 1970, 

It is necor.snry to proceed very quickly. The main purpose of this RFP is 
To fl^entify those organisations vdiich have the best tochnlcal and organisational 
capabilities necessary for l-'cluslon in- the experiniont .* 

If there are substantive questions which organizations need to have 
answered before submitting their proposals they should contact Mr. Jeffry 
Schiller In the Evaluation Division of the Office of Planning, Research, 
and Evaluation at the Office oi; Economic Opportunity. His telephone number 
Is (202) 382-2809. 



SUBCONTRACT BETWEEN GRAND RAPIDS SCHOOL DISTR.ICT 
AND ALPim LBA*RNnJG SYSTEMS COMPANY 

IFPECTIT’E DATE July BVj 1970 

1.00 GENERAL CONDITIONS 

1.01 Dsflnitlons 

Contractor — school cUstrlct 

Subcontractor -- education company selected by Offlu# 
of Bconomlc Opportunity 

Contracting Officer Office of Economic Opportunity 
Contracting Officer 

Project Marmger — Offlce of Economic Opportunity repre- 
sentative 

Project Director — contractor's representatlva 
Project Administrator -■ subcontractor's representative 
Maimgement Support Group -- Education Turnkey Systems, Inc. 
Testing and Analysis Contractor — to be selected by 
Office of Economic Opportunlly 

1.02 Statement of Work — General 

Contoactor 1ms entered Into an agreement with the Otflc# of 
Economic Opportunliy to participate in a nationwide test 
of the offect of performance Incentives on rernedmi 
education among disadvantaged chU,dren, Contractor rec^- 
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nizes Its duty to improve the xmding and mathematics sffils 
of elementary and junior high sGhool students who are now 
below standard. Subcontractor has developed an .innovative 
instructional approach In teaching those needed ricHls. 

Statement of V/ork « Specific 

Subcontractor shall conduct an Instructional program {here- 
e^er referred to as an Accelerated Learning Achievement 
Center) for 100 students In each of grades 2, 3, 7, 8 and 9. 

The project shall continue for the full 1970-71 academic year, 
consisting of approximately 180 class hours of instruction in 
each of reading and math. Management support will be pro- 
vided to Contractor, and the entire project will be evaluated. 
Subcontractor gmrantees a minimum level of results in terms 
of student achievement* to be held accouritable for those results; 
and to accept payment conditional upon final results. 

l.OS Period of Contractual Obllp.tlon 

The period of contractual performance of tiiis agreement ex- 
tends from the effective date of this agreement to June SO, 1971. 

1,04 Relationships of Office of Economic ^portunity to the Subcontract, 
The terms and conditions of contract number BlC-5217 between 
too Offtoe of Economic Opportunity and Contractor are Incor- 
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porated herein by reference and made a part hereof. This sub- 
contract Is subjeca to prior written approval of the Contracting 
Officer for die Office of Economic Opportunity, Contractor is 
responsible to the Office of Economic Opportunity for die 'per- 
formance of Its subcontractor. Any disputes of fact arising 
under diis subcontract, as raised by either ^rty herei c, shall 
be submitted to the Contracting Officer, whose decision shall be 
binding. 

1.05 Termination 

Subcontractor agrees that continuing performa .j'.e under the sub- 
contract is subject to funding of the prime contract botween Con- 
tractor and the Office of Economic Opportunity. In the event that 
for arg? reason funding ceases during the period of contractol ob- 
ligation of this subcontract or if the prime contmct is terminated 
for the CDvernment's convenience, contractor shall be legally 
authorized by virtue' of die provisions contained herein to 'ter- 
minate the subcontract immediately and request the project man- 
ager within five days to administer post -testa in reading skills 
and arithmetic and all such testing sludl be completed widiin 
ten days thereafter, 

, Under no conditions or clrcumstanceE simU liability to die Con- 
tractor as a residt of termination exceed toe total subcontract 
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price based upon the ternis stipulated in par, 3,02 - grade level 
Increase and 3.03 Interim parformanse □bjectlve tests for ttie 
purpose of establishing the final subcontract price within limits 
of p-r. 3.04 - final price, less any payments theretofora earned 
subcontractor pursuant to this subcontract. 

In the event that the subcomract is terminated wittiln 0.0 days of the 
first day of classroom instruction in the ALAC, the co' ractor 
shall be liable in accordance with the termirmtion clausa ccntainsd 
in its contract with the OBO for actual, reasomble, necessary and 
a locabie costs incurred for performance of terralrmted wo’"k, in- 
cluding reimburBable Cwsts of settlejnent for accounting, legal, 
clerical and other eKpenses necessary for preparation of settlement 
claims togettior with reasonable transportation and ottier costs in 
connection with the protection of property allocable to this sub- 
contract, The subcontractor recovery slmll be restricted to 
actual costs only. 

Any determination of costs under the preceding paragraph shall 
be g-overned by the principles for consideration of costs set forth 
in Subpart 1. 15. 2 of the FPR (42 C.F.R. | 1-lB, 2) as in effect 
on the ^tete of dils subcontract. 

In ^£he event tlmt a teacher or othei- strike In the schools in which 
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the work is to be conducted prohibits the subcontractor's perfor- 
mance for a period of 30 days or more or if the subcontractor can 
not carry out the program for 30 days or more due to an Act of 
God, the contractor has the option either to 1) terminate tlie 
subcontract; or 8) grant an extension of the period of performance 
for a reasonable period for the accomplishment of the work; or 3) 
enter into re -negotiations with the subcontractor eovering such 

matters as the formula for the Incentive, and the period of per- 
formance. 

When termination is based upon the reasons contained in uh# 
immediately preceding paragraph, tiie contractor shall attempt 
to post-test all students enrolled in the program. Where 60% 
of the students presently enrolled are post-t^^ted, the sub- 
contractor shall be ^id on a pro rate, basis pursuant to die 
provisions of paras, J,02, 303 and 2 , 04, Where 60% of Uie 
students are not post-tested and the contiactor and TAG are 
satisfied that the .cbiitractor exerted Its most reasonable and 
best efforts to post-test the students, the subconti^ctor s ha l l 
he imW on the basis of actml costs as if the termihatlon occuiTed 
within the first 60 days of the commencement of dassroom 



Instruction. 




Except as hereinabove provided, termination by the contractor 
shall limit the liability of the contractor to a unit price(s) pro 
rata basis based upon post-tests administered after the date of 
termination. 

UnLess otherivlse provided under this subcontract, the subcon- 
tractor from the effective date of termlratlon and for a period 
of ttiree years after final settlement under Uiis subcontract shall 
preserve and make available to the Government at all reason- 
able times at the office of the subcontractor but v/lthout direct 
'-harge to the Government, all his books, records, documents, 
and other evidence bearing on costs and expenses under Uiis 
subcontract and relating to terminated work. 

1, 06 Successors and Assigns 

All terms, conditions,* and provisions hereof slmll inure to and 
shall bind the parties hereto and each of their Foocessors and 
assigns. Subcontractor slmll not assign or transfer its interest, 
responsibility, or claims ^yable under this subcontract v/ithout 
prlc,' written consent of Uie Oontraetlnq Off icer. 

2.00 SPECIFIC PROVISIONS 

2.01 Duties of Contractor ' • 

Contractor agrees to hire a full-time professional as Proieet 

•f" ■■ 
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Director who shall be the Superinte nde nt' s representative . 
Contractor agrees to provide adequate Becretarlal and clerical 
staff support, and to provide 10 classrooms for the Accelerated 
Learning Achievement Center, Project Director m a y authorize 
the subcontractor to obtain modifications to classroom facilities 
in total amount not to exceed $3200. In such cases, suboontractor 
shall first provide specifications for such modifications to the 
Project Director. 

Contractor agrees to maintain an information exclmnge Involving 
teachers, counselors, consultants, and parents. Contractor 
shall host visitors to the program on a schedule and in aecordance 
wlUi procedures approved 1^ the Pruject Manager which do not 
interfere with the operations of the Accelerated Learimig Achieve- 
,ment Center. 

Contractor agrees to be responsible for ensuring mat any stsrient 
enrolled In me Accelerated Learning Achievement Center and 
attending school on a given day will attend me ccelemted Learn- 
ing Achievement Center progmm, and shall arrange schedrdlng 
of classes, where approprte.te. to facUltate student attendance . 

Contraotor agrees to make replacement study. .is amllable when- 
ever mey are needed. 
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2, 02 Duties of Subcontractor 

Subcontractor agrees to organize and operate the accelera,ted 
Learning Achievement Center, providing Instruction in basic 
reading and mathematics to students selected for participation. 

Subcontractor certifies that the instructional system, materMs, 
and equipment to be used in the project are die same or do 
substantially duplicate, those listed or otherv/iae identified In 
Its response to OEO RFP PRE/E 70-107. Subcontractor further 
certifies that the instructional system, materiaid, and equipment 
being used, the use of which is being charged through the con- 
tractor to the Federal Government, were not developed or fin- 
anced under pravlous Government contracts or grants such that , 
th^ would be available to Uie Government in substenttelly sim- 
ilar form without charge, in the event that ar^r such Instructional 
system, materials, and iqulpment have been developed or financed 
under a previous Government contract or grant, the Subcontractor 
shall disclose within 20 toys of the effective date of this subcon- 
tract, through the Contractor to the Office of Economic Oppor- 
tuni^, Uie Federal document which fimnced or developed such 
items, the extent of modification of such items both as to sub- 
stantive content, testing valitotlon, and breakdown of costs re- 
lated thereto. 
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If, during the contract period, suhcontractor wishes to change 
the instructional system, materials, or equipment used, It 
must notify Project Director and Project Manager of any sub- 
stantial changes. Upon their concurrence, such clmnge may be 
instituted, provided, however, if there is a reduction in cost, 
the parties will promptly negot:late a reduction in incentive price. 

The negotiated price shall be subject to the approval of the Con- 
tracting Officer. 

In no event shall Contractor be liable for a change to more costly 
Instructional system, materials, and equipment. 

Subcontractor shall mainte.in records to reflect all actiml start- 
up and operating costs In accordance with reporting forms and 
procedures, and at specified intervals required by Project Director, 
as estebllshed by the Management Support Group and approved by 
the Project Manager, Subcontractor agrees to supply promptly 
ail cte,ta and other irrforraatlon required by the Project Director 
for the reporting system and for other uses. 

Subcontractor agrees to provide a full-time professional em- 
ployee on-site during working hours to provide so rvl ces spec- 
ified herein. Subcontractor furUier agrees maintain the 



level of effort of personnel and equipment required on-slte over 



the full contract period to assure the maxirnuin possible education- 
al development for each student, but in anv event no less than the 
level established by the Project Manager. Any major revision 
in me level of effort from me level esttmatsd in subcontractor's 
proposal to the Office of Economic Opportunity must be approved 
by the Project Manager. If such revision is agreed to and sub- 
stantially reduces Subcontractor's cost, Contractor and Sub- 
contractor shall promptly negotiate a, reduction in me incentive 
price. The negotte.ted price is subject to the approval of the 
Contracting Officer. In no event shall Contractor be liable for 
a higher cost, 

Subeontractor agrees to maintain and service all equipment , 
used in the project and to immediately replace equipment 
not repaired v/lthin 7 work days . If Subcontractor has 
proprietary rights over any instructional equipment, it fir- 
mer agrees to expend a reasonable amount of effort in traln- 
g locai personnel employed I / Contractor in me malntenanca and 

servicing of said equipment, upon requist of Contractor. 

Su^ontractor agrees to train or orient maimgement staff seloctsd 
lay Contractor and Management Support Group in the use .of maimge- 
ment techniques and approaches involved in Subconij'C.c.tor's in- 
structloml system, 
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Subcontractor agrees to submit In writing to the .Management Support 
Group and the Project Director, for their use in monitoring the over- 
all project, a management plan v/lth specific Usk assigmnents, 
activitias, and planning charts not later than fjicean (16) days after 
the beginning of instruction. Subcontractor agrees to make avail- 
able all internal planning and operatlonar documents related directly 
to the instructional operation of the project. 

Subcontractor shall have the Accelerated Learning Achievement 
Center in operation of the first full day of classroom instruction 
in the school diEtrict for grades 7, 8, 9 September 3, 1970 and 
for grades I, 2, 3 September 4, 1970. 

2. 03 Use of Local Personnel 

Subcontractor agrees to the requirements made by Cnntmctor on 
toe employment, tralnlnq. certification, payment, and use of 
local persoimel, as deta iled in Appendix B. atteched to tols sub- 
contract and made a part thereof . 

2 . * nelectlon and Attendance of Students 

AU students who are potential partici^nts in this program will have 
grade level deficiencies in reading and mathematics as determined 
^ any one of three nationally normed, standardized comniercta,lty 
available achievement tests to be sdected and administered by the 
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Office of Economic Opportunity or its designee; and will be from 
poverty area schools. Participants will come from grades 1, 2, 

3, 7, 8 and 9 or their equivalent, for a total of 600 students, 
approximately 100 students per grade. Students will be selected 
for participation by random assignment by th :> Office of Economic 
Opportunity's designee from a target population pool of 150 
students per grade. Contractor shall obtain written parental 
consent for students to be placed in the project. Students to 
be considered for control purposes will also be randomly assigned 
from that pool. No student shall be placed in the pool who would 
not be eligible and accepted for instruction in Contractor's reg- 
ular classes. 

During the first twenty (20) days in which a student participates in 
the Accelerated Learning Achievement Center, that student sliall 
receive diagnostic testing by the Subcontractor to determine in- 
dividual treatment. If, dviring that twenty (20) day period, Sub- 
contractor disagrees that the student is qualified to participate 

because of emotional or mental reasons unr^ated to standardized 
test results, he may request the student's removal in writing to 

the Project Manager. Upon the Project Manager's determination, 
an individual test v/ill be administered by a qualified psychologist 
in consultation with the Testing and Analysis Contractor. In all 
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cases, the Project Manager's decision on student participation 
shall be final and binding. Those students remaining after the 
twenty (20) day period shall remain in the program for the full 
number of class days normally scheduled for the school for all 
students, Ar^ student who does not remain shall be the subject 
of inquiry and certification by the Testing and Analysis Contractor, 
and the reasons for students leaving the program shall be a sub- 
ject in the evaluation report. 

For the purpose of this subcontract, and more particularly 
paragraph 3. 05 below, the following are the only bona fide 
reasons for a student leaving the program* absence for a con- 
tinuous period of 15 days or for intermittent periods t'otbiling 20 
days in any three-month periods* and/or if parents riqueat re- 
moval, In all these cases. Subcontractor shall give written state- 
ment from the parent, and the validity of the stated cause shall be 
certified by tii# Testing and Anatysis Contractor. 

Subcontractor shall dally furnish the names of any absent students, 
and Contmctor shall use the same efforts and procedures as are 
used for all other students in the school district to ensure attendance 
at ma^e-up and at future sessions. If the student transfers to 

9 

another school in the district. Contractor staH track tiiat student 
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and facilitate his contiriued attendance in die Accelerated Learning 
Achievement Center. If regular school schedules are changed. 
Contractor agrees to ensure that time win be araUabla for the 
selected students to continue to partlci^te. 

A student's attendance In the program shall t-; subject to normal 
school disciplinary procedures, up to suspension or expulsion 
from classes of 10 continuous or 15 intermittent days in a tiiree- 
month period. At that point he may be treated as a dropout as 
outlined earlier in 2, 04, re: boia fide reasons for a student 
leaving the program. Subcontractor may request contractor 
to initiate disciplinary action in accordance with normal school 
procedures based on student behavior in the AJoAC, 

Student participants who reach le^l age to voluntarily discon- 
tinue their regular school atten&nce may do so, and may be 
permitted to continue in the program. Where Contractor 
has a General Equivalency Diploma program, the student may 
receive credit toward ttat diploma 1^ his partlcpation in the 
project. The performance of such a student sh^l continue to be 
the subject of payment to Subcontractor but will not be used for 
final evaluation pimposes, 

Wherever possible, sbidents who leave tiie prog fam for any 
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reason shall be post-tasted foi* evaluation purposes by the 
tasting and Analysis Contractor, as more specifically set 
forth in Clause 2. 06. Contractor and Subcontractor slall 
use their best efforts to obtain such post-tests, ^rticularly 
by notifying the Testing and Analysis Contractor upon learn- 
ing tiiat a student may be leaving the program. 

V/hen a vaeancy occurs, it shall be certmed by the Project 
Director. A replacement who can be scheduled into the 
Subcontracted program 



and Analysis Contractor v/ithin. 3 days and placed in the program by 
the Contractor within 3 days. No replacemeiits shall be made later 
than tiilrfy (30) days before the end of the project. If the pool needs 
to be increased, students will be selectad for inclusion on toe same 
basis as students v/ere originally selected. Pinal decision on re- 
placements rests with the Project Manager. 

Any transportation required to facilitate attendance of students in 
the Accelerated Learning Achievement Center shaU be provided 
^ Contractor, with ej^enses borne 1^ It. 

2,00 Testing 

Nntiy and exit level status of each student particlwint will be de- 
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temiiied by ccoreB on any one of three nationally normed, standard- 
ized, commercially available achievement tests admmistered at 
the beglrming and end of the 1970-71 academic year by the Office 
of Economic Opportimity or Its designee. Office of Economic 
Opportunity in conjunction with the Project Director shall supervise 
these and the interim performance test. Such tests will be the basis 
for determlnlrig student achievement gains and subcontractor reim- 
bursement, No information whatsoever shall in ai^ vray be dis- 
closed to subcontractor as to v/hat teat or what forms of the test 
have been or will be used, except for ihat information which the 

project maimger makes available to all other subcontractors. 

Project Mamger shall .lave the right to test wlUi any Instrument 
Uiat he deems appropriate for his own maimgement requirements 
a sample participants at any time after participants have re- 
eeived a minimum of twen^ (20) hours of instruction in eltoer 
reading or matiiematics. Such testing sh^l not interfere wiUi 
the subcontmetor’s Instructional time, A sample number of 
participants slmll be tested four (4) months after completion of 
instruction to determine rates of retention. Said tests shaE not 
be administered earlier than two weeks after the first day of 
elasses for school year .1971-73. Results of the retention test 
wUl be used for Office of Economic Opportunity evaluation pur- 
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poses. 
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Subcontractor has the right to administer any tests that are part 
of his program for the diagnosis and placement of students or for 
Subcontractor's internal program assessment. 

Tefjts and testing procadures for project evaluation and for Sub- 
contractor payment purposes or both shall be under the authority 
of OEO or its designee. 

Testing of student progress under the autoority of OEO or its 
designee shall be as follows: 

. The procedures for determining the pre-test, post-test, net 
^in scores per individual student shall be as follows: 

a, OEO with the advice of the Marmgement Support Contractor 
and the testing and Ana^sis Contractor shall loinUy select, 
three (S) commercially available, latloMLlly norihed, standard- 
ized reading and arithmetic tests and/or subtests. 

b. Not more than ten (10) days after the contractor's Urst day 
of classes, OEO or designee shall administer the tiiree tests, 
all forms, one test per student, to the appropriate grade 
levels. Subcontractor di a ll not be told, nor steU he 
attempt to determine in dry manner whatsoever wlmt test 

or what ivrm of what test arjy student received. Suteon- 
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tractor Ghall be iiiforiiied the Project Marager ten (10) 
days prior to the pre-test of the level of the test to be used 
for each grade level Involved, in the project, and all other 
information referred to in ^ragra^ 2, OS above. 

No earlier than ten (10) days prior to the contractor's 
last Ml day of classes, June 4, 1971 (unless otherwise 
approved by the Project Nfe,nager) 010 or its designee 
shall administer the post -test to each student. The 

f " 

post-test slmll be a different form of the same test 
that was administered to the student as the pre-test. 

Prior to the post-testing, Uie subcontmctor shall not 
be told, nor shall he attempt to determine in B.ry man ner 
whatsoever what test or v;hat test or what form of what test 

aiy' student shall receive. No later than thirty (30) days 
prior to the scheduled post-test, the sub-contractor slmll 
notb^ in writing the testing and armlysis contmctor, stlp- 
ulatihg and justifying the test level it wishes to be utilized 
for each student or groups of students participating in the 
project, 

TA.C will make recommendations to die Project Nferager 
regarding the appropriate test levels to be used. The 



Project Manager wUl deternnine die test levels to be used. 
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e. OEO or Ite designee shall have the authori^ over toe 
pre and post testing conditions to ensure that such con- 
ditions are as comparable as is possible, including makp 
up examinations. Exceptions to comparabill^ of pro ; nd 
post test conditions sliall be Investigated by the Testii.g 
and Ansdysis Contractor and reported to toe OEO with 
recommen<te.tions. The OEO shall then mstoe a deter- 
mination which shall be binding upon both parties of this 
subcontract. 

2.05. 2 The procedures for assessing student achievement on sub- 
contractor's interim performance objectives shall be as 
follov;si 

a. The assessment of student performance on toe sub- 
contractor's interim performance objectives shall 

take place within 7 days of the following dateax 
Inter im Assessment #1 pctober 16, 1970 
Interim Assessment #2 November 25, 1970 
Interim Assessment #3 Janua]^ IB, 1971 
Interim Assessment #4 Februaiy 26, 1971 
Interim Assessment #5 AprU. 16, 1971 

b. No later toan August 26, 1970, Subcontractor shall submit 
to the Test and Anilysls Contractor the Instruments it 



proposes to use for each Interim Assessment, #1 through 
#5. Subcontractor shal). Indicate the objectives to be 
assesssd and the relationship of the objectives to the Sub- 
contractor's curriciilum. Purthermore, the Subcontractor 
shall submit an Item pool, to consist of no less than Uiree 
(3) times the number of Items the Contractor deems necessary 
, for the assessment of each objective. The proposed instru- 
ment must be desicned by the Subcontractor so that one 
hundred (100) percent of the students win correcUy answer 
and/or perform seventy -five (76) percent of the items. 

The Test and Analysis Contractor shall certify to the OEO 
tiiat tile objectlvas to be assessed are a felr measure 
of the Subcontractor's curriculum and timt the items are 
a Jteir measure of the objectives. 

If the Test and Analysis Contractor is not satisfied with 
the Subcontractor's 100-76 performance levels, tiie 
objectives, or the number and relevance of the Items, it shall 
stipulate in writing to Uie OEO and Uie Subcontmctor the reasons 
for its dlsBatlsfaction, with recommendations for bnprovement. 
OEO, v;ith toe assistance of the Project Director, shall then 
negotMe such conditions and their reme^ with the Subcohtractor, 
The subsequent OEO findings and actions wUd be final and binding 



upon the Subcontmctor and shall not be subject to disputes. 

f, H the Test and Analysis Contractor is satisfied with the objectives 
and the items * it shall randomly sample items from Uie Item pools 
to build the final instrument. 

g. The OEO or its designated representetlve shall administer the 



interim assessment tests. The Subcontractor shall see the 
instruments used no sooner than the day they are to be administered, 
2. 05, 3 Only ih# Office of Economic Opportunl^ shall authorize the re- 



lease of ary test results to the public. In all cases, they slmll 
be group scores and not individual scores. Neither Contractor, 
Subcontractor, htonagement Support Group, Testing and 



2, 06 Penaiy for Teaching Test Items 

The Testing and Analysis Contractor will perform a pre-audit 
of toe Subcontractor's Instructional progTam prior to but not 

later tlmn October 1, 1970, to determlai that stanterdlzid 

test Items are not Included in toe currlculumi. The Project 



Ajmlysls Contractor, or any of their employees or con- 



sultants shall release test results or cause them to be 



made public in ary way wltoout written permission of the 
Project ^tanager, Office of Economic Opportunity, 



^te-imger, through the T,A*C. , reserves the right to con- 
duct continuing audits of toe curriculum to insure Umt 
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standardized post-test items are not included, 



The test question item pool procedure ind the use of a variety 
of standardized tests is intended to prevent affirmative in- 
fluencing of student performance on standardized, norm refer - 
enced tests by forelcnov/ledge of questions to be asked, common- 
ly called "teaching to tests". Suspicion that such an event has 
been attempted or accomplished sMll be stated in writing to 
the Office of Econoinlc Opportunity and communicated immed- 
iately by telephone to the Managenient Support Group. Repre- 
sentatives of the Oflice of Economic Opportunity on its desig- 
nees shall immediately visit the project site and determine 
flie validity of the charge, the number of ^rticipants affected, 
and wheUier any damage Vi/as caused. The Office of Economic 
Opportunity shall have the authority to termhate the project 
for caiise at &at point and to require the Subcontmctor to 
return all funds ^id him by the Contractor. 

2,07 LiabUity 

Contractor shall owe tiie same duty of care and responsibility 
to student participants In Subcontractor's instructioral compon- 
ents, whitiier operated during or after regular school hours, 
as it does to Uiose same student's when in regular classroom 
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situations. Any additional insurance premiums necessitated 
shall be borne by Contractor. Contractor shall a.ssume liabil- 
ity for any damage, personal or proper^, occurring out of 
tlie transporting of students to or from Subcontractor operated 
fecilities . 

Subcontractor shall assume liability for its employees and 
for any accident occurring on premelses under its control. 
Subcontractor is responsible for equipment and other proper^ 
maintained on Contractor's premises and shall insurQ against 
loss or damage tiiereto. Where Subcontractor property or 
matertel is kept on premises under Contractor control, Sub- 
contractor may require a reasombl# improvement of securi^ 
measures. 

Subcontractor agrees to purchase within five toys of the 
effective date of this subcontract a performanc# bond in 
the maximum amount of the subcontract, r^ectlng an in- 
surable Interest in both the Contractor and ffie Office of 
Economic Opportunity. The performance bond shall taamed- 
iately be submitted to the Contmcting Officer for his approval. 

Subcontractor, shall In no way be considered an agent of Uii 
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Contractor or the Federal Government, The Subcontractor 
shall indemnify and hold harmless the Contractor and the 
Federal Government from any or all acts or omissions of 
the Subcontractor, Its agents or employees, arising in 
ar^ manner under this subcontract. 

2. 08 Student Rights 

Recent decisions in amriety of jurisdictions Including the 
Supreme Court have established student constitutional 
rights as against school districts, their agents, and 
administrative and instructional personnel. Subcontractor 
shall assume that the same constltutioiml prohibitions 
apply to it. Subcontractor and Contractor actions in 
regard to all student participants, particularly in the 
event of expulsion firom the program, must meet consti- 
tutioM.1 requirements, espectol^ those of procedural and 
substantive due process. 

2.09 Copyrights and Patents 

l^ragraphs 40 and 41 of Clause xni -«■ GeMWil Provisions 
of the prime contract between the Ottlce of Ecohomic Oppor- 
tunity and Contractor are included herein by reference, 

3.00 j^yment Provisions 

3.01 Fixed Pricejincentlve Clause 
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The performance incentive measurement for establishing 
interim and final subcontract price shall be tesed on ttia 

results of pre- and post-test ^ins as measured by standardized 
tests established in each subject and interim performance tests 
after completion of each period of approxunately sbE v/e^cs or 

30 hours of instruction in each subject. 

.02. GRADE LEVEL. INCREASE MEA . "RED BY NATIONAL STAN DAEP 
iZBD TESTS 

''Seventy five percent of the total unit price of this subcontract 
is based upon grade level achievement increase above the min- 
imum guarantee of 0. 75 grade gain in grades 1-3 and 1.00 grade 
gain in gradoB 7-9 in accordance with the schedule below. 

Grade Gains Price per gain level 

above minimum guarantee 

Price (GradftR 1-3) Price (Grades 7^9) 



.7B- .99 


$56. 25 


0 


1.00 -1.24 


75.00 


$75. 00 


1.25 -1.49 


93.76 


93. 75 


1.B0-1.7B 


112. 60 


112, 50 


1.75-1.99 


120.00 


120.00 


2.00-2.49 


127. 50 


127. 60 


2. 60-2. 99 


135.00 


135. 00 


3.00-3.99 


142. 60 


142. 50 


4, 00 and over 


150.00 


150.00 



03 INTERIM PSRFORMANCS OBJECTIVS MEASUREMENT TEST, 
In addition, the subcontractor shaU receive one-fourth of the total 
unit price w $37. BO per student in each subject based on each 
student's satisfectory completion of the predetermined pro- 



110161107 of 76% level in the five interim performance tests. 

The unit price for each student for Batisfactory completion 
in each subject of each interim performance objective test is 

$7.30. The student interim performance objective standard 
level tests approved by the evaluation contractor shall be final 
and binding on both pirtles. 

3,04 Final Price 

The average fixed maximum unit price based on gains in 
achievement level and interim performance objective tests 
shall not exceed $300,00 per student for both subjects based 
on a maidmum of 360 Instructional hours for the school year. 
The total maximum incentive price for this subcontract for 
both subjects shall not exceed $180,000.00, 

3,06 Student Drop Out Unit Price 

{a) K any student drops out or othervy Ise leaves die program through 
no &ult of the Subcontractor and for reasons beyond its control 
as more fully detailed In ^ragraph 2,04 and obtains less Umn 
30 houi's of instruction per subject, the basis for establishing 
unit prices shall be Uie followlngi 

On a percentage of attentonce time of tii# student dropout 
to total instructloral time based on the mean average of 
the totaT Incentive price payments for students remaining 
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in Uie whole progmni divided by the number of these 
students, for each grade level, 

(b) Every student dropout from the AIAC program who was in 

the program for at least 30 hours of instruction per subject 
and remains in altendance in the school district shall oa post 

testnd and the basis for esiablishlng unit prices shall be the 

following: 

1. A rate of $6, 50 for each 0, 1 grade level gain in- 
crease provided Uie student meets the minimum 
guarantee requirament on a pro rata basis, and 

2. $7. 60 for each interim performance objective test, 
that die student attains a 75% level of satisfactory 
completion or better, 

3. In addition the subcontractor shall recsive for the 
onsutne IPO tost that the student dropout is not In 
atten{to,nce, a fraction of one IPO payment based on 
the time the dropout Is in attendance after taking his 
last IPO test to a total of 30 hours of instruction in 
each subject. One IPO test payment X Dropout hours 
In attendance after last IPO test, 30 HOURS 

3, 06 Student Replacement Unit Rrtoe 

The tesls for establishing unit prices for the replacement 
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students shall be as follows: 

(1) $6. BO for each 0. 1 grade level incraase in each 
subject based on pre-test/post -test gains, provided 
the student meets the minbnum guamntee requirement 
under Oils subcontract on a pro rata basis, and 

(2) $7. 50 for each interim performance objective test 
taken, that the student attains a 75% level of satlsfectory 
completion or bettor. 

(3) In addition. If the replacement does not take the 
first IPO test, the subcontmctor shall receive a fraction 
of one ]PO payment tesed on the time from the ctote the 
replacement enters the AMC program to the date of the 
first IPO test in attendance divided by a tote.1 of 30 hours 
of Instruction time In each subject, e.g. One IPO 
payment X Replacement Student hours in attendance to 
the First IPO test. 

3. 07 Limitation of Payment 

Notv/ithshLnding ary oUier provision of this subcontmct, the 
subcontractor stell recelva Interim provisional payments 
equivalent to80% of tha estimated total maximum price. This 
80% Interim provisional ^yment ^all be separated Inta seven 
installment payments as follows: 

163 

aM86 




by the subcontractor of the interim 
performance objective tests to the 
testing and analysis contractor. 



2nd payment — _ a lump sum of $21, 000 for attenclance 



2nd payment 



of a minimum of 60% of target student 
population at each grade level as cer- 
tified by die T.A.C. 



3rd dirough 

7di payment -- $35 for student, after evidence of admin- 



istmtlon of each Interim performance ob- 
jective test in both subjects to each student 
in attendance as certified by the prima con- 
tractor’s school project director. 



V/ithin 46 &ys after the final post-measure test results are estab- 



lished and reported by the evaluation contractor to die subcontractor, 
the subcontractor shall submit an adjusted final voucher with detailed 
Sapporting information for each unit price for each subject for each 
student enrolled in the program and total addltioMl amounts that 
may be due in both subjects. Any amount of thi total provisioml 
payments in excess of the final determined total price based upon 
student performance on interim and final tests shall be reimbursed 
by the subcontractor through die prime contractor to the Govern- 



3, 07 ''Students Not Tested* H a student Is uimble to take a^ regularly 
scheduled test that is a basis for subcontiactor reimbursement 
or regularly scheduled make-up tests, and if said student has 



ment. 



been in attenclance at the Accelerated Learning Achievement Center 
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no less than eighty ■five (86) percent of the time for the Instructional 
period being evaluated, it shall be assumed that said student’s score 
1 ’' th# sanie as the average test of gain score, whichever is approprtoite 
for all students in that Accelerated Learning Achievement Canter or 
the same grade level as said students''. 

00 SUBCONTRACT APPROVAL 

This subcontract shall not be effective until approved In writing 
by the Contiacting Officer, The date of such approval shall con- 
stitute the effective date of this subcontract, 

.00 SPECIAL PROVISION 

It is understood by the ^rties hereto that the subcontractor 
shall be bound by the following clauses found in the prime 
■.untract humber BIC-5217, Clause Xin - ' General pro- 
visions; 5, 7,43, 21, 22, 23, 24, 36, 37, 30,. 40, 41, and 44. 
V/herever in the prime contract the v/ord "Government" 
appears, the word "Contractor" should be substituted there- 
for, and v/herever the word "Contractor" appears the word 
"Subcontractor" should be substituted Uierefora. 

00 Add " 13" to General Provisions Glauses subcontractor is 

bound by. Add new sentence "Subcontractor's response to 



OEO. EFP PRE/E 70-107 is Incojporated in this suhcontmct 



by reforence. " 



sicfned' 

C.R, Muth Alpha Learning Inc. 

Acting Suparintandent of Schools 
0/mnd Rapids Public Schools 



